-- Logs begin at Mon 2022-05-16 19:39:44 UTC, end at Mon 2022-05-16 20:55:01 UTC. -- May 16 20:22:08.586185 dv-cinder-777031-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 20:22:08.596502 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 20:22:08 2022] *** May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: nodename: dv-cinder-777031-16-iscsi May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: machine: x86_64 May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: clock source: unix May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: pcre jit disabled May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: detected number of CPU cores: 4 May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: current working directory: / May 16 20:22:08.597150 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: detected binary path: /usr/bin/uwsgi-core May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: your processes number limit is 47680 May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: your memory page size is 4096 bytes May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: detected max file descriptor number: 2048 May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: lock engine: pthread robust mutexes May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: thunder lock: enabled May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 20:22:08.597683 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 20:22:08.649004 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: Python main interpreter initialized at 0x556a7ac829c0 May 16 20:22:08.649004 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: python threads support enabled May 16 20:22:08.649004 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: your server socket listen backlog is limited to 100 connections May 16 20:22:08.649004 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: your mercy for graceful operations on workers is 90 seconds May 16 20:22:08.649409 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: mapped 403077 bytes (393 KB) for 2 cores May 16 20:22:08.649473 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: *** Operational MODE: preforking *** May 16 20:22:08.649753 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: *** uWSGI is running in multiple interpreter mode *** May 16 20:22:08.649753 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: spawned uWSGI master process (pid: 79833) May 16 20:22:08.649936 dv-cinder-777031-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 20:22:08.651934 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: spawned uWSGI worker 1 (pid: 79845, cores: 1) May 16 20:22:08.652419 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: spawned uWSGI worker 2 (pid: 79846, cores: 1) May 16 20:22:08.654396 dv-cinder-777031-16-iscsi devstack@keystone.service[79833]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 20:22:14.294504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:22:14.294504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: from cryptography.utils import int_from_bytes May 16 20:22:14.295297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:22:14.295297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: from cryptography.utils import int_from_bytes May 16 20:22:14.295920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:22:14.295920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: from cryptography.utils import int_from_bytes May 16 20:22:14.296069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:22:14.296069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: from cryptography.utils import int_from_bytes May 16 20:22:14.344002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:22:14.344189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:22:14.344260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:22:14.344339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:22:14.344410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] command line args: [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:22:14.344665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] command line args: [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:22:14.344750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:22:14.344750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ================================================================================ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:22:14.344865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:22:14.345037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ================================================================================ {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:22:14.345127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] admin_token = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] admin_token = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_dir = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] config_dir = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_source = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] debug = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.345844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] config_source = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.346001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] debug = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.348948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_config_append = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_config_append = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_dir = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_dir = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_file = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.349971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.350941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] publish_errors = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.351854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] publish_errors = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.352689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.352867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.353057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.353246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.353433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.353656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.353864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.354158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.354329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.354523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.354717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] standard_threads = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.354944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] standard_threads = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.355112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.355302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.355488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.355674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.355866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.356089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.356253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_journal = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.356474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] use_journal = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.356648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_json = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.356836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] use_json = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_stderr = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] use_stderr = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_syslog = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] use_syslog = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.357887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:22:14.358015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.358889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.359922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.360885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.361919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.362998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.363910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.364899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.365951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.366934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.367997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.368989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.369115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.369243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.369379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.369507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.369635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.370826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.370996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.371186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.371412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.371575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.371762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.371952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.372139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.372329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.372561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.372726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.372948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.373117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.373313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.373513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.373859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.374021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.374274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.374474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.374637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.374824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.375975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.376907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.377963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.378940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.379862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.380959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.381087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.381221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.381418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.381562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.382911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.383942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.384881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.385946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.386890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387026 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.387958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.388937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.external = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.389981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.external = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.password = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.390941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.token = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.password = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] auth.token = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.391985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.392909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.393976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.394888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.395936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.396874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.397946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.398973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.399925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.400865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.401923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.402990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.403923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.404872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.405927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.406978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.407898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.408879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.409986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.410975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.411877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.412970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.413928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.414902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.415959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.416922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.417970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.418891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419552 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.419987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.420874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.421925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.422980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.423906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.424999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.425917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.426951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.427871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] role.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] role.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.428920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.429960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.430877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.431936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.432938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.433883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.434982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.435948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436548 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.436871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.437976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.438933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.439932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.440960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.441930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.connection = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.442916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.443903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.444887 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.445991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.446890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447160 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:22:14.447858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:22:14.447858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:22:14.458455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.458681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.458827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.458965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.459105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.459259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.467596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.467749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.495896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.496122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.496961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.497196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.548793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.549067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.599679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.600004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.600158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.600302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.665237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.665472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.665639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.665787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.665927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.666781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.690862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.691965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.702773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.703583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.717581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.717856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.718877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.719565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:22:14.736470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.736686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:22:14.736897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.736897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:22:14.737169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.737309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:22:14.737446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.737446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:22:14.737716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.737853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.737992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.738142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.738280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.738426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.738565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.738702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.749973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.750112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.750265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.758511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.758719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.761805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.762009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.762163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.762319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.762469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.762608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.762747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.762899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.763753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.764938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.791017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.792657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.792911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.794219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.795839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.796119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.798219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.798478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.798784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.801464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.801663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.801933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.806121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.806375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.809166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.809455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.811039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.811303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.811602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.811864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.812159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.812400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.812720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.812959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.814045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.814328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.814600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.814902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.815227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.815479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.815765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.816004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.831742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.831994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.834661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.834916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.836609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.839493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.840240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.840560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.843129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.843424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.845569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.848471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.849259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.852062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.853020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.853314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.853573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.853880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.854171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.854414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.855810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.856104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.856384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.856682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.856978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.857259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.873383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.873761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.873978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.874340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.878572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.878952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.879196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.879468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.882595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.884321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.884621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.887673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.887927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.888105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.888252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.888488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.888794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.889703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.889952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.893308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.893595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.893871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.894161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.894390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.902245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.902476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.902788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.903077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.903335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.903638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.903885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.907702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.907983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.908255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.908571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.908886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.909169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.909439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.925873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.927347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.929294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.931761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.932585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.934166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.935321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.935784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.936056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.936342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.937244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.938960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.939308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.939666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.943796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.945450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.947397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.948679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.948962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.949237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.949419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.949556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.952659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.953016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.953358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.953700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.958626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.958905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.959206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.963211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.963569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.963919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.967158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.967446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.967705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.967971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.968236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.968538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.968806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.969079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.969340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.969600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.969840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.970099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.970365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.970625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.973154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:22:14.973526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.973877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.974220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.974556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.974915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.975250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.975610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.975943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.976280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.976639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.976976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.977321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:14.977646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:22:15.009961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a7ac829c0 pid: 79846 (default app) May 16 20:22:15.013460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e67c-480d-4889-a89e-a458a652fcd0 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:15.013752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e67c-480d-4889-a89e-a458a652fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:15.013996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e67c-480d-4889-a89e-a458a652fcd0 None None] PATH_INFO: `/v3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:15.017350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a7ac829c0 pid: 79845 (default app) May 16 20:22:15.018253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon May 16 20:22:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:22.903659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:22.904265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:22.904265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:22.908855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:22.913943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:22.914383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:22.914608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:22.946760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG oslo_db.sqlalchemy.engines [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:22:23.133073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG passlib.handlers.bcrypt [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79846) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 20:22:23.133499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG passlib.handlers.bcrypt [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79846) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 20:22:23.188400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:23.190030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:23.315526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 20:22:23.471669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:23.510937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG oslo_db.sqlalchemy.engines [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:22:23.638395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c4f17-8b7a-45de-9189-9642a357a94e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:23.643081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:23.643748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:23.644028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:23.644301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:23.653147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:23.703499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING keystone.common.rbac_enforcer.enforcer [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 20:22:23.703795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d4f17-be38-415e-aa88-bd5a5470845d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:23.714409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon May 16 20:22:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:22:23.720472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:23.735239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522ba6a-3fdf-4159-8548-1b2c71a354de None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:23.741263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:23.742513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:23.742863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:23.743211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] PATH_INFO: `/v3/projects/cd0e31e92b6648feab627c19ac9bf98d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:23.744981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] RBAC: Authorizing `identity:get_project(project_id=cd0e31e92b6648feab627c19ac9bf98d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:23.794501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 20:22:23.794835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91fd02-ffd3-4c5b-8528-ce148d1a690b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:23.799571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon May 16 20:22:23 2022] GET /identity/v3/projects/cd0e31e92b6648feab627c19ac9bf98d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:25.997717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc12ac-4c95-4e52-884e-50989d83561d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:25.998251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc12ac-4c95-4e52-884e-50989d83561d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:25.998251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc12ac-4c95-4e52-884e-50989d83561d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:26.002359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:26.008783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:26.009221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:26.009323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:26.030113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:26.031638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:26.040450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 20:22:26.063258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc12ac-4c95-4e52-884e-50989d83561d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:26.080816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc12ac-4c95-4e52-884e-50989d83561d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:26.085503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:26.086165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:26.086449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:26.086729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:26.095644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:26.097506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74301330-21af-405f-91b5-b7ce3fc5fbcf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:26.107894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon May 16 20:22:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:22:26.113755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:26.125697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe851ef6-f2ba-42a8-b89b-04265fdb24a8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:26.136361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:26.137281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:26.137566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:26.137844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:26.139338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:26.141332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5c5e-dbee-4696-801c-c0140ea94c8a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:26.143160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon May 16 20:22:26 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:28.402940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12b4d-cb19-4ab8-bfef-e4bfbc5911e8 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.403514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12b4d-cb19-4ab8-bfef-e4bfbc5911e8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.403514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12b4d-cb19-4ab8-bfef-e4bfbc5911e8 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.405082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:28.410525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.411008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.411203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.455304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6613-3497-4c96-bbc2-0e64d3dec6a8 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.455549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6613-3497-4c96-bbc2-0e64d3dec6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.455853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6613-3497-4c96-bbc2-0e64d3dec6a8 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.457253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:28.463307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.463598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.463880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.506517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG passlib.handlers.bcrypt [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79845) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 20:22:28.506947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG passlib.handlers.bcrypt [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79845) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 20:22:28.543190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:28.544402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:28.553272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:28.554865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:28.623350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:28.646933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:28.655900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:28.677179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:28.743143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc84eb-42eb-4db1-9c28-71f34aad9263 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:28.774682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:28.775516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.775781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc29446-4bf9-4cb9-b28e-bb03f67ac2ef None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:28.775919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.776051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.787499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:28.798732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:28.799732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:28.800605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:28.806005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:28.811168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:28.812095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.812382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.812823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.877013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:28.878531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:28.906527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a3bc-1394-4984-93b1-d4b64f74cf93 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:28.939822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:28.940514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:28.940781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:28.941093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:28.941849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:28.942151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:28.943549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:28.955224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:28.960830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:28.978164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:22:28.984184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:29.068189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319966-97c4-4133-b309-cd0ebe42f5cd None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:29.103985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:29.104904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:29.105390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:29.105658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:29.106936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:29.108400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:29.110063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:28 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:29.115512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:29.196423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0356a61-2c63-423d-9c9f-e309f362590d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:29.208486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87994-e3f5-4e7c-bab1-e2c429761802 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:29.229610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:29.230420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:29.230705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:29.230972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:29.241128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:29.241915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:29.242217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:29.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:29.243704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:29.245197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:29.246841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:29.249198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:29.250675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:29.252673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:22:29.271275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:29.272123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:29.272983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:22:29.272983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:22:29.272983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:22:29.272983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:29.272983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:22:29.278384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:29.349568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3a0c-abb6-444d-9754-74b1199e9276 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:29.373037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c667d-005b-4685-bd47-a7111124290e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:29.384638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:29.385294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:29.385580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:29.385854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:29.386694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.domain.id=default, user.id=fc0c07a955fe4edc868e35eb1b8525a2) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:29.387028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:29.388489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e0747-2668-40d9-a4b5-115b1b90dd57 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:29.395323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Mon May 16 20:22:29 2022] GET /identity/v3/role_assignments?user.id=fc0c07a955fe4edc868e35eb1b8525a2&scope.domain.id=default&role.id=4f500164fa794f84afa94241394a2b5d => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:29.408091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:29.408820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:29.409087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:29.409363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:29.410122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:29.410426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:29.411881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ec58-e25e-43df-a981-49c43af66cbb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:29.431915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:31.973441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05baeda-b209-4534-9534-92fe50c5f3df None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:31.974434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05baeda-b209-4534-9534-92fe50c5f3df None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:31.974943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05baeda-b209-4534-9534-92fe50c5f3df None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:31.976886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:31.982382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07053ff-1c93-4ad8-862b-61ca59b8d991 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:31.983184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07053ff-1c93-4ad8-862b-61ca59b8d991 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:31.983652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07053ff-1c93-4ad8-862b-61ca59b8d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.009543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f07053ff-1c93-4ad8-862b-61ca59b8d991 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:32.011128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f07053ff-1c93-4ad8-862b-61ca59b8d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:32.103125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:32.131429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05baeda-b209-4534-9534-92fe50c5f3df None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:32.216091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d90fb-e00f-45ea-9e81-ad5600644f34 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.217524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d90fb-e00f-45ea-9e81-ad5600644f34 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.218043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d90fb-e00f-45ea-9e81-ad5600644f34 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.219993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:32.228416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.229190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.229670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.257540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:32.258723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:32.262090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05baeda-b209-4534-9534-92fe50c5f3df None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:32.323708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:32.324541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.324819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.325088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.346024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-0bf29a8c-650e-4b1b-9a54-7f91cd22e638 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:32.358758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:32.359625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:32.360455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 13/25] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:32.361592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaebc8b-7035-46a9-9d87-fb394c91ca43 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.361592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaebc8b-7035-46a9-9d87-fb394c91ca43 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.363868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaebc8b-7035-46a9-9d87-fb394c91ca43 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.363868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 14/26] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:32.375185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.375449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.375732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.395806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:32.396684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:32.410649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:32.411837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:32.541322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:32.542758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:32.587534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e1ab-fde7-4811-8c2b-642dc1fc7b68 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:32.648242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f709bd-f34d-4476-9921-cd9e0911bdd4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:32.669630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:32.670511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.670884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.671256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.672156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:32.672636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:32.674209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:32.694773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:32.695788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.696233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.696694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.697629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:32.699210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:32.704242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:32.705469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:32.880906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ed374-5ca0-412c-87af-4c82c34a85e0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:32.912160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 16/30] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 16 20:22:32 2022] POST /identity/v3/roles => generated 219 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:32.913748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:32.919083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:32.920242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:32.925523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:32.927811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:32.948039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:32.950712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b412fe02-d55c-49f5-b2eb-be2b0660039f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:22:32.987119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:32.988484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:32.989333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:22:32.989333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:22:32.989333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:22:32.989333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:32.995942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:32.999951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639be9-be7d-4881-bbc1-981e583ff45f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.000635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639be9-be7d-4881-bbc1-981e583ff45f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.001432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639be9-be7d-4881-bbc1-981e583ff45f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.006184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 16/32] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:33.009340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639be9-be7d-4881-bbc1-981e583ff45f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.143363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0e70-9d93-45e9-bd68-e3fa5826aba8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.191946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.192952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.193242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.193514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.194858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.195993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639be9-be7d-4881-bbc1-981e583ff45f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.196463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae080f-b91b-4baa-9c3b-521bd0773f44 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.198457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 17/33] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:32 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:33.199807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b468a-9720-4500-87d5-1c984e230518 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.200100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b468a-9720-4500-87d5-1c984e230518 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.200375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b468a-9720-4500-87d5-1c984e230518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.219285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-820b468a-9720-4500-87d5-1c984e230518 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:33.220898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-820b468a-9720-4500-87d5-1c984e230518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:33.232219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.232942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.233224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.233495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.234229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:33.234536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.236062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df3fac-c0df-4714-848e-9af00503f557 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.247901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 17/34] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:33.249262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031cdd-fc5a-4060-9c51-35d22faf9f89 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.249704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031cdd-fc5a-4060-9c51-35d22faf9f89 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.250171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031cdd-fc5a-4060-9c51-35d22faf9f89 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.252784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 18/35] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:33.257388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031cdd-fc5a-4060-9c51-35d22faf9f89 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.299846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:33.301006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b468a-9720-4500-87d5-1c984e230518 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.360409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031cdd-fc5a-4060-9c51-35d22faf9f89 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.398574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.399546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.399833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.400114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.402228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.403681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6680d-2978-467f-a629-c87aff8e9831 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.403846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b468a-9720-4500-87d5-1c984e230518 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.407555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 19/37] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:33.408938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.409281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.409615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.425836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:33.427028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:33.442630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.443300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.443581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.443987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.444586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.446034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.484474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 19/38] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/projects => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:33.484474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.512803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 20/39] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:33.513912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.614570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257831-6d5d-43c0-b162-21ffccc0f04d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.657198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c01c65-0a64-410f-94b8-b0a3790c8b61 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.666412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.667424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.667933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.668410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.669456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.671079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.690455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:33.691621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:33.701098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.702382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.702804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.703270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] PATH_INFO: `/v3/domains/default/users/fc0c07a955fe4edc868e35eb1b8525a2/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.706070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fc0c07a955fe4edc868e35eb1b8525a2, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.707792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30fbc-9611-4d25-8778-e0028af84476 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.817181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea968be4-3ec6-4461-8c05-a6fc2a60d128 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:33.833538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1361 bytes} [Mon May 16 20:22:33 2022] PUT /identity/v3/domains/default/users/fc0c07a955fe4edc868e35eb1b8525a2/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:33.835686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d151849-e470-4946-921c-901b0152ed69 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.836113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d151849-e470-4946-921c-901b0152ed69 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.836600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d151849-e470-4946-921c-901b0152ed69 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.841297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 22/42] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:33.847708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.848000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.848282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.858385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:33.859570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:33.860141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:33.860654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:33.861703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:33.863233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:33.868159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:33.870368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:33.882140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 21/43] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:33.960949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 23/44] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:33.985867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:34.095334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f344cb-ac32-4812-95d9-fca314d99f94 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:34.127821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:34.128661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:34.128948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:34.129227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:34.130772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:34.132240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df873869-3830-4a3a-88cb-f35b0954934a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:34.133900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:34.140036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:34.243696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab695e-c2cf-40a3-ad3d-289326802938 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:34.279181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:34.279857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:34.280179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:34.280467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:34.281262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:34.282961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ebac4-212b-4689-99ea-c814d9bf4c98 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:34.312107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:22:34 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:36.062219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061788e-4fd5-4dbd-9ff3-ea6434f7a9f4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.062775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061788e-4fd5-4dbd-9ff3-ea6434f7a9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.062775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061788e-4fd5-4dbd-9ff3-ea6434f7a9f4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.064137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:36.069685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.070122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.070221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.088273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:36.089539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:36.158688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:36.181469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061788e-4fd5-4dbd-9ff3-ea6434f7a9f4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.285563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061788e-4fd5-4dbd-9ff3-ea6434f7a9f4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.319053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.319780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.320068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.320337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.331478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:36.339510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:36.340614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:36.341393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 24/49] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:36.347832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.444960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e0808-ad2c-4806-b0c3-999287d1423c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.478433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.479103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.479379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.479652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.480417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:36.480754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.482140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555178a-c4d7-48da-9d30-73ad310dd182 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.490391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 26/50] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:36.496178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.519314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a1be-3ae8-4269-9404-9e5a479a4b6a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.519582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a1be-3ae8-4269-9404-9e5a479a4b6a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.519864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a1be-3ae8-4269-9404-9e5a479a4b6a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.521283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 27/51] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:36.526525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.526812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.527101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.544382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:36.545629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:36.593104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe62b-6376-4ac4-9cfe-4f290b266d6d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.610723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 28/52] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:36.626657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.627540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.627815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.628086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.629336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.631158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.632791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 25/53] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:36.637186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.638072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.730756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328b05-a712-4035-99cb-528e1014407a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.734664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26a833-6b2c-4760-9b6a-9cf0ba6ac49a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.765162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.765963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.766274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.766558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.767803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.768897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.769291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.769690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.769975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.770251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.771208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 26/54] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:36.771434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.772916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.774673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:36.776729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.780095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:36.870990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a092-ce2a-4abe-ad60-e128ebe3d89c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.873994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f701dcd-e1b9-461a-864e-86b6d769b471 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:36.902868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.903523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.903806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.904082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.904805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.906243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2abce-cefb-4037-9bab-6139b8741e95 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.909068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:36.909717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:36.910001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:36.910279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:36.911092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.domain.id=default, user.id=fc0c07a955fe4edc868e35eb1b8525a2) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:36.911401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:36.912847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d51ef-4876-4318-93aa-b97d6db9edca None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:36.918947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 27/56] 10.222.0.49 () {56 vars in 1322 bytes} [Mon May 16 20:22:36 2022] GET /identity/v3/role_assignments?user.id=fc0c07a955fe4edc868e35eb1b8525a2&scope.domain.id=default&role.id=4f500164fa794f84afa94241394a2b5d => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:36.933031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 30/57] 10.222.0.49 () {60 vars in 1140 bytes} [Mon May 16 20:22:36 2022] POST /identity/v3/projects => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:22:39.167930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dff633-14a6-44b7-9b77-62addf8197f0 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:39.168776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dff633-14a6-44b7-9b77-62addf8197f0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:39.168917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dff633-14a6-44b7-9b77-62addf8197f0 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:39.171031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:39.177833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:39.178266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:39.178448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:39.205372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:39.206584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:39.272097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:39.306586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dff633-14a6-44b7-9b77-62addf8197f0 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:39.442203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dff633-14a6-44b7-9b77-62addf8197f0 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:39.475634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:39.476422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:39.476740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:39.477019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:39.478313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:39.479781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b884-0e57-46f7-b8f4-923094ff4b10 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:39.481460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:39.487729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:39.591407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8091103-7b09-429f-b40d-ed5c99543851 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:39.629205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:39.629883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:39.630528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:39.630808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:39.631520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:39.633029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b777-c87d-4e5a-b55f-f2f522711900 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:39.666754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:22:39 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:43.200811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6fe0-0b38-4c1f-af31-0c8c54651831 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.201361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6fe0-0b38-4c1f-af31-0c8c54651831 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.201361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6fe0-0b38-4c1f-af31-0c8c54651831 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.203059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:43.208466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50ac3-1b7f-4e80-8f6e-766b829fa1ae None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.209082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50ac3-1b7f-4e80-8f6e-766b829fa1ae None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.209082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee50ac3-1b7f-4e80-8f6e-766b829fa1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.220069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c65d-a63b-4166-9b55-ddd58639e15e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.220417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c65d-a63b-4166-9b55-ddd58639e15e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.221021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c65d-a63b-4166-9b55-ddd58639e15e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.222786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:43.228337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc727-fb6c-4784-9b0e-71f327a7867d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.228981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc727-fb6c-4784-9b0e-71f327a7867d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.229455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc727-fb6c-4784-9b0e-71f327a7867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.252624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6ee50ac3-1b7f-4e80-8f6e-766b829fa1ae None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:43.254230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6ee50ac3-1b7f-4e80-8f6e-766b829fa1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:43.256207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-917dc727-fb6c-4784-9b0e-71f327a7867d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:43.257706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-917dc727-fb6c-4784-9b0e-71f327a7867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:43.329511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 33/64] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:43.331544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf08d-3136-44a4-bf31-f294097e7aea None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.332061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf08d-3136-44a4-bf31-f294097e7aea None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.332600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf08d-3136-44a4-bf31-f294097e7aea None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.334392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 34/65] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:43.339913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:43.355870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecf08d-3136-44a4-bf31-f294097e7aea None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.356684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.356986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.357264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.377770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:43.379461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:43.448852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 33/67] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:43.457446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.485601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecf08d-3136-44a4-bf31-f294097e7aea None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.520613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.521524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.521887 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.522165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.533242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6d868080-b71e-48d0-b75a-813407969180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:43.542326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:43.543486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:43.544259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 35/68] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:43.545273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee5-59bc-4d87-b06a-b8a73dcf5b84 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.545273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee5-59bc-4d87-b06a-b8a73dcf5b84 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.545387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee5-59bc-4d87-b06a-b8a73dcf5b84 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.550734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 36/69] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:43.550734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676ee5-59bc-4d87-b06a-b8a73dcf5b84 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.570494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95f9be-8357-442b-acb7-7ab577bfab53 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.601887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.602665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.602949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.603232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.613038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:43.620609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:43.621674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:43.622452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 34/70] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:43.623098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.653455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676ee5-59bc-4d87-b06a-b8a73dcf5b84 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.690267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.691341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.691626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.691902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.702057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a47cc001-0007-42a6-8036-8885eac77501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:43.710341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:43.711221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:43.711999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:43.712665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.713209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.713209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.727787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926e7f-74e8-4416-9816-97a414ad5cbf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.729288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:43.730485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:43.761746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.761936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.762179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.762452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.763198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:43.763503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:43.764932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0720018-a78c-43c5-a61a-89b7a2cb3764 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:43.773012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 35/72] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:43.774391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798505-8a26-46ce-9bd3-be59721d8fe2 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.774818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798505-8a26-46ce-9bd3-be59721d8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.775233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798505-8a26-46ce-9bd3-be59721d8fe2 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.776636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 36/73] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:43.777456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b798505-8a26-46ce-9bd3-be59721d8fe2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.793939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 38/74] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:43.794780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.874360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b798505-8a26-46ce-9bd3-be59721d8fe2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.893748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f9ae-382e-4fb1-b359-3d655d464649 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:43.907632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.908333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.908622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.908891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.909652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:43.909973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:43.911356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:43.919099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:43.919875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:43.933429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:43.934107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.934395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.934664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.935420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:43.935723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:43.937149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c441d7e-818a-4ed2-ba06-dc8985b775f2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:43.944772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:43.945932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:43.946200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:43.946494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:43.962040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:43.963140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:44.014991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10a7c3-0ceb-46fb-ab7b-47397c8bc4ab None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.027245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 40/77] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:44.028118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.046929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.047841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.048122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.048396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.061302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.062758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.064506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 38/78] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:43 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:44.065341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.127810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091374b-e1ac-4242-85c8-49bb3b10f840 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.156392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03a04-0156-41a9-acfc-a6fd015e969f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.160853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.161655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.161944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.162222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.163392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.164914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.166563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 41/79] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:44.167327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.189200 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.190124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.190413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.190698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.191909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.193388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.195043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 39/80] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:44.195794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.267867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbedeb-283c-4e73-9945-edfed53a93d2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.296821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad8acb-a8ca-45c7-aa96-5dd063f347dc None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.301420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.302312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.302581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.302851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.304027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.305513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.307167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 42/81] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:44.307924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.330772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.331577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.331860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.332137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.341926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:44.349662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:44.350579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:44.351354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 40/82] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:44.351996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.411321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8afae5-d2ff-4708-8d39-fd014e7878fb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.445213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.445872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.446158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.446439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.455338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958daf9-78e8-4757-bbcb-9e1b6fece002 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.489129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.489800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.490083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.490357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.491062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.492531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.512829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.514687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.519170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 41/83] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:22:44 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:44.519940 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.621873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 43/84] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:44.623192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.630431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90c75-4015-42a6-b65d-9d820c3aa02c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.668338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.669441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.669712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.669988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.726366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ba89-2c35-469f-bf8e-6ded712f8cef None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.740052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.741608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.761748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.762717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.763181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.763597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.840564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 42/85] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:44.841392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.847338 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.848991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:44.951736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3a47-808c-4f6f-b156-bca8344c1d31 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:44.959923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 44/86] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:44.960972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:44.988657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:44.989351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:44.989635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:44.989916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:44.990735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:44.991048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:44.992542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.001141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 43/87] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.002040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.061567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8eaa-d5fa-40b0-b3f4-ad3d13182f3a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.096204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.097042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.097329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.097605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.098812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.100290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.102044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 45/88] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:44 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.102899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.105157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c9ca-2714-4397-b911-94adf07d7353 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.141711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.142704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.142991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.143267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.144670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.146151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.148127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 44/89] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.148829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.223808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5528a-9138-4dcb-a1b7-b873ef383aca None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.260655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.261867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.262338 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.262796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.263237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf191e-5b1d-45ef-b92a-7ead3904f3cd None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.264394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.266181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.269493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 46/90] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.271886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.298433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.299418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.299709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.299990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.301229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.302690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.304708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 45/91] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.305712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.372414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540308-cba6-4cea-9338-3ede975233b3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.402978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505196a6-ebd0-430e-b199-e9e3f64c386a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.407021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.408269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.408769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.409235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.410320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:45.410858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.413538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.423800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 47/92] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.424952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.439049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.439851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.440140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.440473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.441466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=fc0c07a955fe4edc868e35eb1b8525a2) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:45.441700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.443217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.452625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 46/93] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/role_assignments?user.id=fc0c07a955fe4edc868e35eb1b8525a2&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.453685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:45.538970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d7697-6e77-46c5-baaf-5ba36ba00cf9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.576711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.578186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.578877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.579639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.581051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:45.581570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.583254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.589945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 48/94] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=294f84347b07412085947d751f52f815 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:45.627457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679324-b0bd-4af9-b692-528c9da561d8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:45.688715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:45.689450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:45.689739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:45.690077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:45.784911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:45.786612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:45.919297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 47/95] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:45.925350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:46.037074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3861ef-cfe9-4523-ab29-265bb25d6141 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:46.075866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:46.077171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:46.077645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:46.078104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] PATH_INFO: `/v3/projects/f5065b21f71c4c02937b1f8c965db53e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:46.079493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] RBAC: Authorizing `identity:get_project(project_id=f5065b21f71c4c02937b1f8c965db53e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:46.081290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572c7d2-28bd-478a-b02c-cae12a340704 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:46.083245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:45 2022] GET /identity/v3/projects/f5065b21f71c4c02937b1f8c965db53e => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:46.093573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:46.209991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e425f-63b3-4d25-a4b0-c6fcc10f8af7 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:46.251941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:46.253011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:46.253502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:46.253962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:46.255365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=f5065b21f71c4c02937b1f8c965db53e, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:46.255863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:46.257553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d87f-1ea8-423f-9f7d-7f99ab0aee26 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:46.264061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:46 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=f5065b21f71c4c02937b1f8c965db53e&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:47.193919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ccde-1330-4732-8593-8eb3aa1e6d78 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.194438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ccde-1330-4732-8593-8eb3aa1e6d78 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.194438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ccde-1330-4732-8593-8eb3aa1e6d78 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.196059 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:47.201442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.201826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.201988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.225404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:47.226879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:47.315440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 49/99] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:47.344610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ccde-1330-4732-8593-8eb3aa1e6d78 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:47.469845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ccde-1330-4732-8593-8eb3aa1e6d78 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:47.520078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:47.520932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.521214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.521492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.534065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b62fe743-34f0-45db-89e4-5af6288edef2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:47.541675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:47.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:47.544242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 51/100] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:47.549001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:47.649893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e79d26-d686-43c3-bc4f-e033dde6d79e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:47.676291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb1a8-fc30-4bb9-b098-141383b69c45 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.676606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb1a8-fc30-4bb9-b098-141383b69c45 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.676861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb1a8-fc30-4bb9-b098-141383b69c45 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.678233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 52/101] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:47.683494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.683772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.684044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.703103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:47.704155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.704829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.705336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.706337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:47.706844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:47.708500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:47.709818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:47.711269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:47.717845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:47.729543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:47.822802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 53/103] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:47.902792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7058cb-3d97-4028-99d6-61f37e9ef1a4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:47.910556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:47.936487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:47.937476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:47.937771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:47.938051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] PATH_INFO: `/v3/users/a61b0263ab70466f9517925f23562ad5` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:47.951362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] RBAC: Authorizing `identity:get_user(user_id=a61b0263ab70466f9517925f23562ad5)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:47.952874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:47.954617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 51/104] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:47 2022] GET /identity/v3/users/a61b0263ab70466f9517925f23562ad5 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:47.960142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:48.056741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d8255-1ae8-40a5-84bb-77d0e32e563d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:48.061944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043d646-d3ea-4db4-9497-7384be2c31f0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:48.090163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:48.090972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.091363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.091763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.105978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:48.106993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.107412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.107817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.109169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:48.110783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:48.112941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 54/105] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:48.119117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:48.173232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:48.175016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:48.235450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b4e6-861e-4e6c-b718-531b6ae355b5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:48.270061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:48.271102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.271583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.272066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.273029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:48.274714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:48.295158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 52/106] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:22:48.301076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:48.305096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 55/107] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:22:48 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:48.433932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47562f1-cf56-424f-a2d2-274dfc9bb3f3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:48.468803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:48.469691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.469970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.470379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.471604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:48.473150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6f4c7-1981-4f70-a62e-70282c37bbba None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:48.474884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 53/108] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:48 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:48.481661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:48.644158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86892ac-9ddf-4a03-8ddc-7b0ef0b7b4a6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:48.702392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:48.702992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.703278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.703555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.704400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=a61b0263ab70466f9517925f23562ad5) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:48.704790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:48.706265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba1e8-c6d8-49da-b47f-5241d05ff9c7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:48.716537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 56/109] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:48 2022] GET /identity/v3/role_assignments?user.id=a61b0263ab70466f9517925f23562ad5&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:48.987095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ed36-e2cb-4647-8435-0f0594ef709e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.987297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ed36-e2cb-4647-8435-0f0594ef709e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.987733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ed36-e2cb-4647-8435-0f0594ef709e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:48.989353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 54/110] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:48.996088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a0f2-2773-4352-b642-386dae4a1f89 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:48.996794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a0f2-2773-4352-b642-386dae4a1f89 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:48.997277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a0f2-2773-4352-b642-386dae4a1f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.017626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5960a0f2-2773-4352-b642-386dae4a1f89 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:49.019194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5960a0f2-2773-4352-b642-386dae4a1f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:49.088325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 57/111] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:49.104945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b60f1-caab-4eeb-bac4-79f76c9d006e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.105594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b60f1-caab-4eeb-bac4-79f76c9d006e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.106075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b60f1-caab-4eeb-bac4-79f76c9d006e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.107698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 55/112] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:49.113742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69554-6867-4c23-b23a-0a76e8e330e8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.114305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69554-6867-4c23-b23a-0a76e8e330e8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.114798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69554-6867-4c23-b23a-0a76e8e330e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.123070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b60f1-caab-4eeb-bac4-79f76c9d006e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.143268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-27a69554-6867-4c23-b23a-0a76e8e330e8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:49.144974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-27a69554-6867-4c23-b23a-0a76e8e330e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:49.217395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 58/113] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:49.236469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4049d9-2abb-4d21-82c7-6f3b27ea7ea3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.237144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4049d9-2abb-4d21-82c7-6f3b27ea7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.237144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4049d9-2abb-4d21-82c7-6f3b27ea7ea3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.238633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 59/114] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:49.244746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4049d9-2abb-4d21-82c7-6f3b27ea7ea3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.289674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b60f1-caab-4eeb-bac4-79f76c9d006e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.344097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.344934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.345348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.345626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.346652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4049d9-2abb-4d21-82c7-6f3b27ea7ea3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.370601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ea374a05-b7b5-4935-8e30-f6665f50574b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:49.378971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:49.380235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:49.381041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:49.381669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.382496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.382786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.383063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.384566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 56/115] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:22:49.386140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.386654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.387166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.394812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:49.404520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:49.405451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:49.406235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:49.408719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 60/116] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:49.412467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.423281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:49.424880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:49.516550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8543-bf4e-43a7-b969-d67b0ff30371 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.551099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 57/117] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:49.551854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.566130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.566884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.567291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.567640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.568501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:49.568882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:49.570359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:49.593902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 61/118] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:49.594977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.710751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bed93-b5a3-4e88-b426-51749f7c5f3a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.762882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.763606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.764534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.764824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.768239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:49.768555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:49.770819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:49.782373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 58/119] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:49.788452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.898554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb615461-be46-4a4c-8583-769cc7362cef None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.925008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a50f6-bcbf-4e58-8685-5eae8007ecaa None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:49.943234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.944198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.944497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.945050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.958903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:49.962285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:49.963171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.963515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.963797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.965101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:49.966586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4254ff-0ac2-4541-a0e6-fe2ecc09dbac None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:49.966802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:49.967666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:49.968515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 62/120] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:49.969206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 59/121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:49.969282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:49.970258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5259-c4f5-4e77-ab11-09e30b8eeea4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:49.973942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5259-c4f5-4e77-ab11-09e30b8eeea4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:49.974254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5259-c4f5-4e77-ab11-09e30b8eeea4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:49.975747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 60/122] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:49.977535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5259-c4f5-4e77-ab11-09e30b8eeea4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.087003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a82e-5699-47eb-883b-bff9c7be6ad1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.089619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5259-c4f5-4e77-ab11-09e30b8eeea4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.120718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.121830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.122118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.122326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.122502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.123040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.123318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.123596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.123748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.124926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.125365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.126628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283cb6e-bbd4-43f7-9973-53133c6675de None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.127385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 63/123] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.133190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.133840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 61/124] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:49 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.135730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.136023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.136298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.153491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:50.154706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:50.228658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 62/125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:50.229498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.243664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf142fe-a19b-45a7-b745-4ab098aea3af None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.284166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.284882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.285176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.285451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.286216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:50.286523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.287934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.296505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 64/126] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.301394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.351999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1f0c-2d04-4a8b-8a0a-38bae9401b74 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.393210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.394565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.394855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.395436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/users/fc0c07a955fe4edc868e35eb1b8525a2/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.397899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, user_id=fc0c07a955fe4edc868e35eb1b8525a2, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.399636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.400299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f26788-5246-4d8e-9ac9-4de13a97085e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.419510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 63/127] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:22:50 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/users/fc0c07a955fe4edc868e35eb1b8525a2/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:50.420210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.437519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.438521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.438911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.439433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.440971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.442858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.446183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 65/128] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.452550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.537461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee973-aa4c-46c1-a3fc-821642982561 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.570166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f53604-e38b-4504-9da1-dc9abccb1e71 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.580087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.581302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.582836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.583069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.596184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:50.606801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:50.607904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:50.608948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:50.610120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.611190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.611418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 64/129] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:50.611704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.612072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.616456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.616456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.616908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.622183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 66/130] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.623427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.748853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b49f7-2966-4a4c-bab9-526614143531 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.784835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.785745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.786035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.786319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/users/05a40660aa4e49c19e3672f6cd646096/roles/294f84347b07412085947d751f52f815` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.788658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, user_id=05a40660aa4e49c19e3672f6cd646096, role_id=294f84347b07412085947d751f52f815)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.790140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.797123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bfda-83f9-4968-a124-e4fd95fd245a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.807914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 65/131] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:22:50 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/users/05a40660aa4e49c19e3672f6cd646096/roles/294f84347b07412085947d751f52f815 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:50.808860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.834522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.835759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.836229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.836815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.838429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.840203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.842636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 67/132] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.850407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:50.913871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b943-7d47-4ad9-96b6-f66400b332b4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:50.948349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:50.949075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:50.949364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:50.949649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:50.950434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:50.950729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:50.952131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:50.961216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 66/133] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:50.967086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:51.026395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fe578-483d-400b-9eff-c142c20e9399 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:51.071395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99e942-2f22-4b97-b222-9c73f6f5d311 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:51.089863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:51.091116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.091606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.092069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/users/05a40660aa4e49c19e3672f6cd646096/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.094237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, user_id=05a40660aa4e49c19e3672f6cd646096, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:51.100533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:51.117438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:51.120282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.120282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.120282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.121336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:51.123109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:51.125103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 67/134] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:50 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:51.131629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:51.140323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 68/135] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:22:50 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/users/05a40660aa4e49c19e3672f6cd646096/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:51.283308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe578d-67b3-4762-8651-c4d7ee3c419e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:51.328012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:51.329214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.329733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.330151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] PATH_INFO: `/v3/projects/f5065b21f71c4c02937b1f8c965db53e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.337313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] RBAC: Authorizing `identity:get_project(project_id=f5065b21f71c4c02937b1f8c965db53e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:51.339031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f452d24-2a0a-4418-996c-bf01ac9aeacd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:51.341049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 68/136] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:51 2022] GET /identity/v3/projects/f5065b21f71c4c02937b1f8c965db53e => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:51.347385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:51.472811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba53465-1a95-40c3-b9eb-184c0cbbb4f4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:51.517468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:51.518632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.519089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.519505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] PATH_INFO: `/v3/projects/f5065b21f71c4c02937b1f8c965db53e/users/05a40660aa4e49c19e3672f6cd646096/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.526038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5065b21f71c4c02937b1f8c965db53e, user_id=05a40660aa4e49c19e3672f6cd646096, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:51.527776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:51.538155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39824-058a-42e7-971d-0c5d8119b999 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.538155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39824-058a-42e7-971d-0c5d8119b999 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.538155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39824-058a-42e7-971d-0c5d8119b999 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.539618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 69/137] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:22:51.544672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcff3-2ec3-4b99-b85c-93f50b371062 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.544963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcff3-2ec3-4b99-b85c-93f50b371062 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.545256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcff3-2ec3-4b99-b85c-93f50b371062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.563876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 69/138] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:22:51 2022] PUT /identity/v3/projects/f5065b21f71c4c02937b1f8c965db53e/users/05a40660aa4e49c19e3672f6cd646096/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:51.573583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2c5dcff3-2ec3-4b99-b85c-93f50b371062 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:51.574829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2c5dcff3-2ec3-4b99-b85c-93f50b371062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:51.663488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 70/139] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:51.697717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:51.710369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaeb5-a415-4ab7-bfed-dbd951651498 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.711003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaeb5-a415-4ab7-bfed-dbd951651498 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.711466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaeb5-a415-4ab7-bfed-dbd951651498 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.713545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 71/140] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:51.720808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.721861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.722332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.741017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:51.742575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:51.854357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 72/141] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:51.873225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f921c-20e9-4765-9601-e3ac70720883 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:51.893858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:51.912057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:51.912890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:51.913180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:51.913456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:51.929332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:51.936947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:51.937808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:51.938618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 70/142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:51.943868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:52.032679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1f5b-4454-40e6-81da-572aa577adcd None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.097899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.098131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.098342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.098567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.099795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.101321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.103000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 73/143] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:52.109755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:52.160130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20ef-e094-4ab4-9faa-bea2e8f1a1b3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.241697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.242393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.242683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.242963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.243731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:52.244041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.245478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.263720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 71/144] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:52.269652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:52.306139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc46c0-0dbb-441d-afc1-758d21cbd769 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.359538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.360286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.360579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.360862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.361592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.363066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.407412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 74/145] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:22:52 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:22:52.442199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d5589-453a-46dc-a295-22ac978a2249 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.494238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.495158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.495442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.495718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] PATH_INFO: `/v3/users/a61b0263ab70466f9517925f23562ad5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.497009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] RBAC: Authorizing `identity:get_user(user_id=a61b0263ab70466f9517925f23562ad5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.498519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.500167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 72/146] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:52 2022] GET /identity/v3/users/a61b0263ab70466f9517925f23562ad5 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:52.506349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:52.664661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d88af-b971-4860-97fb-18f9f4c85556 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.716292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.717218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.717594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.717776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.725376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.726901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e0bcf-04b0-4f86-b361-bdd6fe7e2b11 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.728743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 75/147] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:52 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:52.734481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:52.890900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f2587-f4c8-4676-91a3-4428eef9a331 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:52.938958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:52.939815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:52.940093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:52.940373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/users/a61b0263ab70466f9517925f23562ad5/roles/fa6f32a6915d4618ac45f464f38c8dd0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:52.946113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, user_id=a61b0263ab70466f9517925f23562ad5, role_id=fa6f32a6915d4618ac45f464f38c8dd0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:52.947643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16539dcb-b9c2-451c-be6a-3575cdd8ae72 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:52.970264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 73/148] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:22:52 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/users/a61b0263ab70466f9517925f23562ad5/roles/fa6f32a6915d4618ac45f464f38c8dd0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:22:53.639184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1219-d9d8-4dd8-99cc-46caa126658c None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:53.639550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1219-d9d8-4dd8-99cc-46caa126658c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:53.639754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1219-d9d8-4dd8-99cc-46caa126658c None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:53.641344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 76/149] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:53.646811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:53.647276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:53.647444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:53.664925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:53.666166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:53.732460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 74/150] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:53.757194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1219-d9d8-4dd8-99cc-46caa126658c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:53.857166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1219-d9d8-4dd8-99cc-46caa126658c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:53.891311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:53.892092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:53.892491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:53.892735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:53.903481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:53.911238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:53.912079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:53.912914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 77/151] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:53.918691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.019881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28159e-eebb-4e0d-b039-ba09827beb0e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:54.054186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:54.054883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.055210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.055492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.056260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:54.056597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:54.058001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:54.068249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 75/152] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:54.072884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.180286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760d10-364c-4f5d-b24c-08f4e4691cdc None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:54.214061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:54.214948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.215232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.215505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] PATH_INFO: `/v3/users/fc0c07a955fe4edc868e35eb1b8525a2` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.216738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] RBAC: Authorizing `identity:get_user(user_id=fc0c07a955fe4edc868e35eb1b8525a2)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:54.218199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:54.219924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 78/153] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/users/fc0c07a955fe4edc868e35eb1b8525a2 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:54.225727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.325434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237279dd-14e9-418c-b958-2e77065969ec None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:54.358837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:54.359501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.359782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.360056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.432405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:54.433964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c1228-4ba2-45f9-aeef-7648322667b0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:54.533793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 76/154] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:54.539523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.561019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d609ca-5573-42f4-814b-f444e831d9c7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.561335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d609ca-5573-42f4-814b-f444e831d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.561575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d609ca-5573-42f4-814b-f444e831d9c7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.562966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 77/155] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:54.568324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96e02-9e4b-4edc-bf60-872a5b35d75e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.568637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96e02-9e4b-4edc-bf60-872a5b35d75e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.568919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96e02-9e4b-4edc-bf60-872a5b35d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.598335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-93c96e02-9e4b-4edc-bf60-872a5b35d75e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:54.599538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-93c96e02-9e4b-4edc-bf60-872a5b35d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:54.689962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 78/156] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:22:54.701294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034273c-4532-477a-ad26-6e0453a6ae5d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.701603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034273c-4532-477a-ad26-6e0453a6ae5d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.701865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034273c-4532-477a-ad26-6e0453a6ae5d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.703250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 79/157] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:54.718648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.718951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.719237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.741238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:54.742665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:54.754781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d93f4-9c2a-443a-a11e-1d41a856ca8a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:54.800186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:54.801115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.801398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.801678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.802898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:54.804457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:54.806327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 79/158] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:54.807100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.847327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 80/159] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:54.848281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.909258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9717-e922-4ad1-85f3-c88d684e097b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:54.942776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:54.943506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:54.943792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:54.944071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:54.954572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:54.962336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:54.964350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 80/160] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:54.966226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:54.987060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd93c8-b86a-4eaa-b614-61b895c286f9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.043020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.043689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.043970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.044245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.045128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=fc0c07a955fe4edc868e35eb1b8525a2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:55.045437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.046912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.053344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 81/161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/role_assignments?user.id=fc0c07a955fe4edc868e35eb1b8525a2&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:55.061508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.064513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfc-08a1-4638-a77e-e691c733590e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.099543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.100401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.100696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.100980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.111999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:55.120025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:55.122558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:55.124589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 81/162] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:55.132473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.220305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a74-aebd-40c6-8289-dd14f1c7874e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.240468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1be45-9f90-42fa-ab6b-7f264c14b7c7 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.269964 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.270725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.271017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.271295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.272065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:55.272370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.273895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da308dcc-2a10-4249-8cf5-1c5554533ed5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.288231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 82/163] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:55.289629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae08-bcfc-487d-99f6-52e6dddc6bb2 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.289919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae08-bcfc-487d-99f6-52e6dddc6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.290197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae08-bcfc-487d-99f6-52e6dddc6bb2 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.291807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 83/164] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:55.297672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fae08-bcfc-487d-99f6-52e6dddc6bb2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.302767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.303742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.304215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.304722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.305702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:55.306199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.307807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474a5f3-f8ce-419b-a358-c1c4892c6e8c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.323152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 82/165] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:55.324904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.325417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.325897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.361591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:55.363166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:55.404053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fae08-bcfc-487d-99f6-52e6dddc6bb2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.438867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.439772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.440055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.440333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.441620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.443171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.444985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 84/166] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:55.445762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.490970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 83/167] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:55.491858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.553430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a39fa-66af-4a77-9602-2d029303c40b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.588005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.588943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.589226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.589503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.590716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.592244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.594021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 85/168] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:55.594868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.634035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0fcc5-0ee7-48ce-ab31-a959bbc06074 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.695001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4f29-95d7-4a4a-ac60-b487c4779267 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.698509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.699208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.699492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.699765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.730105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.730949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.731211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.731488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.742212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:55.750362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:55.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 86/169] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:55.752750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:55.788984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.790474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.854923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba1a13-f911-4036-a1af-543d39e080ca None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:55.888611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:55.889268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:55.889553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:55.889833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:55.960470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:55.960470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:55.985103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 84/170] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:55.986316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.059675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 87/171] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:56.060481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.159009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d0b8b-40d1-4185-bbce-61cf436745d1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.192266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.193179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.193463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.193741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] PATH_INFO: `/v3/projects/f5065b21f71c4c02937b1f8c965db53e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.194960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] RBAC: Authorizing `identity:get_project(project_id=f5065b21f71c4c02937b1f8c965db53e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.196415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.197188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2107-5a44-48c8-b5da-0747804c202f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.198166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 88/172] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/projects/f5065b21f71c4c02937b1f8c965db53e => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.198927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.264569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.265631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.266168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.266678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.267677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:56.268171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.269826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.282397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 85/173] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:22:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.288358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.385272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053035-620e-4dae-b506-c5329b4d816e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.447176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.448066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.448373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.448658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.449916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.454315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.456277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 89/174] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.458323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.476941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764d00-8dbd-4ab4-8bdf-c85ddc5449b3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.557155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.559880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.560359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.560869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.562661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=f5065b21f71c4c02937b1f8c965db53e, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:56.563982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.565905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.582705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 86/175] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=f5065b21f71c4c02937b1f8c965db53e&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.583639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.662693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8df4-bb26-4e7d-b1c9-a674b7c069ff None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.690294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd303-a4cb-458c-b4d2-f439e72f0b00 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.725606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.726278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.726491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.726770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.727618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:56.727927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.728422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.729438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.729768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.730243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.730710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] PATH_INFO: `/v3/users/05a40660aa4e49c19e3672f6cd646096` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.732119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] RBAC: Authorizing `identity:get_user(user_id=05a40660aa4e49c19e3672f6cd646096)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.733837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:56.744489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 87/176] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.744489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:56.745222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 90/177] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/users/05a40660aa4e49c19e3672f6cd646096 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:56.873391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072bce3-3299-466e-95c0-d0d2378d072c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:56.910390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:56.910989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:56.911272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:56.911543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:56.983638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:56.985226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:57.086449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 88/178] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:22:57.092273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:57.195663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e17e8-6bd0-45c0-9412-0f6d43c415ff None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:57.229971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:57.230871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.231151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.231425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.237411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:57.238950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c73663-451a-458f-98ec-13fa7ea57073 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:57.240881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 91/179] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:57 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:57.247134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:57.353421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dbb20-b5a7-4d42-afaf-94746d533d94 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:57.390362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:57.391077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.391437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.391714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.392627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=05a40660aa4e49c19e3672f6cd646096) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:57.392943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:57.394460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7cf30-c1dc-43a5-a787-997d215d3bdc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:57.401452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 89/180] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:57 2022] GET /identity/v3/role_assignments?user.id=05a40660aa4e49c19e3672f6cd646096&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=294f84347b07412085947d751f52f815 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:57.473057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ca99-c91f-4cf5-a643-27f7f1a21774 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.473340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ca99-c91f-4cf5-a643-27f7f1a21774 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.473521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ca99-c91f-4cf5-a643-27f7f1a21774 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.474891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 92/181] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:57.481394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8679-89d2-4695-aced-427ed16ae62c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.481718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8679-89d2-4695-aced-427ed16ae62c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.481940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8679-89d2-4695-aced-427ed16ae62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.499834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-438f8679-89d2-4695-aced-427ed16ae62c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:57.501265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-438f8679-89d2-4695-aced-427ed16ae62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:57.589356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 90/182] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:57.606935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3535c-08be-47bd-aca6-3246761b94d7 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.607225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3535c-08be-47bd-aca6-3246761b94d7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.607504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3535c-08be-47bd-aca6-3246761b94d7 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.609262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 93/183] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:57.614827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.615114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.615392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.627866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3535c-08be-47bd-aca6-3246761b94d7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:57.643155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:57.644371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:57.733009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 91/184] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:57.756599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:57.783165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3535c-08be-47bd-aca6-3246761b94d7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:57.830198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:57.831637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.832120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.832773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.846754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:57.856924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:57.857832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:22:57.858642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:57.861920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 94/185] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:22:57.868898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:57.891402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa5f8-23db-4f8f-899e-5dfbe7f47973 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:57.938575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:57.940380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.943388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.943666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.958736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a871fbd4-d0bd-4256-8997-cb0da60ca55f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:57.966707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:57.967718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:22:57.968594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 92/186] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:57.969387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59bb8-d7fb-41eb-96ba-9fcdfb6139aa None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.969650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59bb8-d7fb-41eb-96ba-9fcdfb6139aa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.969920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59bb8-d7fb-41eb-96ba-9fcdfb6139aa None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.971324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 93/187] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:57.977680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:57.978006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:57.978234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:57.986613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f5dec-ce8a-41ef-b124-74b21adfc46a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:57.995663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:57.996917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:58.019932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.020633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.020918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.021237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.021999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:58.022348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.023779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.031992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 95/188] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:22:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.032661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.061908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 94/189] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:58.063104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.148060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59ee-2dff-4e4c-9afa-af3ed0898096 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.163442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d72d5-2ecd-43c8-8306-62be089e6dbe None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.179923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.180624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.180909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.181181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.181938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:58.182241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.183631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.191562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 96/190] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.192339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.199075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.200043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.200352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.200650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] PATH_INFO: `/v3/users/a61b0263ab70466f9517925f23562ad5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.201869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] RBAC: Authorizing `identity:get_user(user_id=a61b0263ab70466f9517925f23562ad5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.203319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a35ea-0600-42fc-a18f-38fe6869ac8e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.205091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 95/191] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/users/a61b0263ab70466f9517925f23562ad5 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.206232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52573d6-771a-44c9-9e71-bf97148d1652 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.206505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52573d6-771a-44c9-9e71-bf97148d1652 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.206737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52573d6-771a-44c9-9e71-bf97148d1652 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.208637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 96/192] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:22:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:22:58.208897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52573d6-771a-44c9-9e71-bf97148d1652 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.290234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11da0f-f649-4b99-9cac-27c2d5d56535 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.303019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52573d6-771a-44c9-9e71-bf97148d1652 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.321376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.322169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.322449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.322714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.323907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.325387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.327011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 97/193] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.328643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.334851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.335739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.336020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.336291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.351329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.352796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b748d-1821-48d4-b0dd-958f8074afde None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.354441 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 97/194] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.355598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.355881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.356157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.373713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:22:58.374897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:22:58.423706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997709d-9cac-4b92-bd92-23159ef5e615 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.439527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 98/195] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:22:58.440332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.456060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.456752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.457030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.457288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.522639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.524110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.535494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e423-2471-4603-8adf-23c2e46ae5a0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.573213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.573824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.574104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.574382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.575098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.576604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.596533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 99/196] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:22:58 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:22:58.597344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.621729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 98/197] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:58.626815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.726080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad2c2-dfb6-476a-9c67-b9e9535fecd2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.733648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c79bb-5422-4b3f-9a8a-0317baf17d90 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.761823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.762382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.762631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.762850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.769132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161760-3461-495d-88e1-e783a7986364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.769963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161760-3461-495d-88e1-e783a7986364 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.770290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161760-3461-495d-88e1-e783a7986364 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.770524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161760-3461-495d-88e1-e783a7986364 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.781498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161760-3461-495d-88e1-e783a7986364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-51161760-3461-495d-88e1-e783a7986364 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:22:58.790528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:22:58.791428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:22:58.792216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 99/198] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:22:58.792917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161760-3461-495d-88e1-e783a7986364 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.833123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.834550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.896647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161760-3461-495d-88e1-e783a7986364 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:58.930048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:58.931184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:58.931609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:58.931882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:58.933111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:58.934555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:58.935470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 100/199] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:58.936346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 100/200] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:58.938358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:58.943059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.036795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2900-e17b-41fc-9387-1f990af2602b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.042998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd3821-5baa-47f7-8248-676a4e696d1b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.070707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.071379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.071657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.071929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.072769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:59.073008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.074404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.077858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.079008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.079467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.079916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.081328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.082561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 101/201] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:59.083222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.083385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.088486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 101/202] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:58 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:59.089127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.188327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6fcd6-dbde-4e81-bd69-843cc3fa52fc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.188885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a4b7-205a-4394-8ebc-5f5094090d4e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.221361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.222603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.223063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.223518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.225325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.225557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.226421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.226894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.227235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.227579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.228656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, scope.project.id=8d64880bd4df407097e717603ec5b713, user.id=a61b0263ab70466f9517925f23562ad5) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:59.229186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.229712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 102/203] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:22:59.230314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.230776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.241990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/role_assignments?user.id=a61b0263ab70466f9517925f23562ad5&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:59.242853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.332719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec361b3-7373-487f-864a-a215feca5d65 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.367546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.368132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.368404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.368701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.369551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=e4dea44858ae4b4e91850c5e0c2cf635) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:59.369862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.371371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.377621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/role_assignments?user.id=e4dea44858ae4b4e91850c5e0c2cf635&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:59.444190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290771-b5c4-4447-a1b3-21150b41e559 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.496536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.497214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.497490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.497763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.574609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.576354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.678653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:22:59.683916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.794698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb520-33c3-4d08-b5ba-96c1386bbc0c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.828642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.829888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.830388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.830860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.832262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.833943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5e8e-95ca-4951-84f4-37c6c6d4a029 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:22:59.836166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:22:59.845704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:22:59.950379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145744-887b-4946-aa74-6d8d95a2e4b4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:22:59.984751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:22:59.985808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:22:59.986311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:22:59.986782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:22:59.987821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=e4dea44858ae4b4e91850c5e0c2cf635) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:22:59.988332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:22:59.990014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067973a6-cc6d-4273-9013-d6c1c83d701d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:00.000537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:22:59 2022] GET /identity/v3/role_assignments?user.id=e4dea44858ae4b4e91850c5e0c2cf635&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=294f84347b07412085947d751f52f815 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:00.990706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54222c-1cff-418d-b2a9-c9a83abf5e3d None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:00.991206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54222c-1cff-418d-b2a9-c9a83abf5e3d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:00.991206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54222c-1cff-418d-b2a9-c9a83abf5e3d None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:00.992616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:00.997851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ec0-53c9-4a83-b4e6-f13e0111822b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:00.998634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ec0-53c9-4a83-b4e6-f13e0111822b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:00.999096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ec0-53c9-4a83-b4e6-f13e0111822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.016700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-03b03ec0-53c9-4a83-b4e6-f13e0111822b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:01.018298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-03b03ec0-53c9-4a83-b4e6-f13e0111822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:01.083702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:01.106440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54222c-1cff-418d-b2a9-c9a83abf5e3d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.119031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7aa-2815-49b1-bd4c-101e596ed0a4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.119336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7aa-2815-49b1-bd4c-101e596ed0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.119591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7aa-2815-49b1-bd4c-101e596ed0a4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.121025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:01.126052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.126337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.126621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.143307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:01.144519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:01.218579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54222c-1cff-418d-b2a9-c9a83abf5e3d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.224135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 107/212] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:01.248324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.267198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.268694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.269149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.269591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.283971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:01.293315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:01.294191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:01.295003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:01.297623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 106/213] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:01.303480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.350831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7a4e8-9866-4f23-ad9e-6131f3ea392c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.385404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.386360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.386732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.387100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.388608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:01.390175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:01.392081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 108/214] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:01.397401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.402959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffccd2b-7592-4ab8-b650-861bb6302cd6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.435910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.436899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.437348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.437831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.438731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:01.439174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:01.440724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:01.453755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 107/215] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:01.455166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.495812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894071d-d6c0-448f-afd4-b8a26faf160f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.532019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.532836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.533575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.533575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.534378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:01.535996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:01.560519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93221a-1f1b-413f-be0a-781af91432ec None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.562093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 109/216] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:01 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:23:01.601256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.602483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.602937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.603458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] PATH_INFO: `/v3/users/37c6f4a5839e455ab0d34dac58734b45` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.619120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] RBAC: Authorizing `identity:get_user(user_id=37c6f4a5839e455ab0d34dac58734b45)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:01.621101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028438c3-6fda-4704-8642-f590d89c04ec None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:01.627868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 108/217] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/users/37c6f4a5839e455ab0d34dac58734b45 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:01.630054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.710303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483b61-2dba-44dc-82ca-5be777e9c6cc None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.710582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483b61-2dba-44dc-82ca-5be777e9c6cc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.710855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483b61-2dba-44dc-82ca-5be777e9c6cc None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.712242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 109/218] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:01.717644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.717924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.718199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.740089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:01.742233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:01.751430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7629-4bfc-402a-a8b6-b9bda8865df3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.795795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:01.797010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:01.797451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:01.797732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:01.827477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 110/219] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:01.848048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:01.873410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:01.874950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:01.971135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470bc4-2a73-44bb-abf8-676aa6bbed27 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:01.994409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 110/220] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:01.999982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.008034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.008904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.009505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.009505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.020232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:02.028071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:02.029027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:02.029834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 111/221] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:02.036371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.103942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cda33-30fb-4fd8-a19c-13f60080c520 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.137929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.138800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.139079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.139349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.139580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0267f-b806-4a36-8ea8-0ee661403bbc None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.140595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.142094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.143808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 111/222] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:01 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:02.149829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.173380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.174056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.174337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.174611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.175461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:02.175773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.177213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.186242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 112/223] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:02.193469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.250847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1caab-d773-44a4-a527-0d50a0d440d3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.296386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.297154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.297435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.297710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.298552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=37c6f4a5839e455ab0d34dac58734b45) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:02.298862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.301111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c4d6-cbfa-4c28-baac-5154808fcc5b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.312524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 112/224] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/role_assignments?user.id=37c6f4a5839e455ab0d34dac58734b45&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:02.314455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f7d-1aba-4c0a-a17d-2f5e7d2097f3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.315099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f7d-1aba-4c0a-a17d-2f5e7d2097f3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.315560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f7d-1aba-4c0a-a17d-2f5e7d2097f3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.317501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 113/225] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:02.319657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e741d4-dbde-4fdc-9cc1-9ea047a52f5b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.327004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.327004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.327004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.362383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:02.363526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:02.383827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.384799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.385078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.385359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.388331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.389908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.392002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 113/226] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:02.401525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.515189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 114/227] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:02.536904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201120-2bd1-49be-b2d7-31493f4e37a0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.551312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.597368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.598258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.598536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.598814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.600022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.601502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.603405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 114/228] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:02.608968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.671397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe6d72-ae2d-460e-a53a-9f4035ef15e5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.705761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.706598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.706872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.707148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.717366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:02.725646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:02.726574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:02.727365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 115/229] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:02.737204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:02.778476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9890b0-5cd7-40c2-b220-a2e062fa245f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.843512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.844503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.844788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.845064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/e4dea44858ae4b4e91850c5e0c2cf635/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.850006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, user_id=e4dea44858ae4b4e91850c5e0c2cf635, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.851471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.893599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e22a-c7fd-4283-8b60-7e44c4e1d01a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:02.899067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 115/230] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:02 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/e4dea44858ae4b4e91850c5e0c2cf635/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:23:02.939264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:02.940529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:02.941015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:02.941477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:02.942827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:02.943389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:02.945158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:02.963870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 116/231] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:02.969936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:03.089955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed843-3e3e-4a2c-9e18-c99e8c327314 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:03.134095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:03.135036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:03.135318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:03.135590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:03.136987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:03.138489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:03.140384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 116/232] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:02 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:03.145919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:03.276267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea28-353d-42c9-9b3f-3f321c3df71e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:03.329189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:03.330463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:03.330952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:03.331412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:03.332836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:03.334486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486775b1-09ce-418e-b86d-c5df929be35f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:03.336387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 117/233] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:03 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:03.342049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:03.458037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1654df-5075-434e-95f9-bc55752796a2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:03.495972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:03.496905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:03.497190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:03.497465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/e4dea44858ae4b4e91850c5e0c2cf635/roles/294f84347b07412085947d751f52f815` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:03.499854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, user_id=e4dea44858ae4b4e91850c5e0c2cf635, role_id=294f84347b07412085947d751f52f815)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:03.501426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0245-6442-42df-a99d-5fd1d1360a78 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:03.526464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 117/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:03 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/e4dea44858ae4b4e91850c5e0c2cf635/roles/294f84347b07412085947d751f52f815 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:04.370482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7307-7dce-4535-9b7c-6214337b268c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.371502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7307-7dce-4535-9b7c-6214337b268c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.371974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7307-7dce-4535-9b7c-6214337b268c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.373685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 118/235] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:04.379835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.380719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.381185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.398468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:04.399953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:04.467231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 118/236] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:04.490622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b7307-7dce-4535-9b7c-6214337b268c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:04.627271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b7307-7dce-4535-9b7c-6214337b268c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:04.679244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:04.680394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.680910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.681363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.697285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ab21ebc1-8686-41a1-8f22-85ab031b2326 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:04.705505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:04.706379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:04.707184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:04.709567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 119/237] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:04.715699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:04.820477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e21bf-6ae3-430d-9548-5a4da1cf5405 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.821130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e21bf-6ae3-430d-9548-5a4da1cf5405 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.821588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e21bf-6ae3-430d-9548-5a4da1cf5405 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.823211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 120/238] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:04.829561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.830061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.830520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.852108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:04.854396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:04.867942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c059-1c95-4064-85b2-3c235da9758a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:04.930032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:04.930722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.931012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.931278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.932107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:04.932341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:04.933787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ec58-6e2e-4318-ae12-68098eb6efc4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:04.945974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 119/239] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:04.947743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 121/240] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:04.952375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e0f-6748-4f36-92b5-f55b61f7e990 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.952897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e0f-6748-4f36-92b5-f55b61f7e990 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.953477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e0f-6748-4f36-92b5-f55b61f7e990 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.955062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 120/241] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:04.956671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:04.970234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.970840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.971304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.990420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:04.991931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:05.067753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd185-fa23-444f-be14-fcce2e629342 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.073778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 121/242] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:05.075003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.125523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.126430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.126731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.126969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] PATH_INFO: `/v3/users/8cb4746ce2e24e059ced9509075e8871` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.146563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] RBAC: Authorizing `identity:get_user(user_id=8cb4746ce2e24e059ced9509075e8871)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.148118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.150260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 122/243] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:04 2022] GET /identity/v3/users/8cb4746ce2e24e059ced9509075e8871 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:05.155808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.197239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c5b83-09a1-46cb-892e-9a7efdc0fd38 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.230591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.231706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.232180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.232681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.243786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:05.252042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:05.253101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:05.254298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:05.256667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 122/244] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:05.257658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.281671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df103b6a-8a07-40ed-a6c5-03cbbcd68f17 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.315652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.316870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.317356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.317809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.319434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.321128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.322948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 123/245] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:05.323923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.381449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984a90-981e-46ea-b230-6df387a82991 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.413956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.414908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.415374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.415854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.435878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbbca-7d56-4576-943f-d9cfda6de899 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.479150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.479810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.480094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.480371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.481438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:05.481749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.483662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.484915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.486576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.493181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 124/246] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:05.497308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.592127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 123/247] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:05.597906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.610099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912a8f4-c6db-401f-ace4-9acde2d7ff3d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.643364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.644050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.644331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.644662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.645365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.646986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.672300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 125/248] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:05 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:05.681490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.751713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1895653-1b01-43d3-aa98-4aa6876088a2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.790102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.791009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.791371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.792106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] PATH_INFO: `/v3/users/37c6f4a5839e455ab0d34dac58734b45` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.793695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] RBAC: Authorizing `identity:get_user(user_id=37c6f4a5839e455ab0d34dac58734b45)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.795194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8c02-92f0-40e9-a9bf-712016cd6bff None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.798224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 124/249] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/users/37c6f4a5839e455ab0d34dac58734b45 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:05.799915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0740ba-6e56-4b14-9bd1-5679410c034d None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.800204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0740ba-6e56-4b14-9bd1-5679410c034d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.800499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0740ba-6e56-4b14-9bd1-5679410c034d None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.802892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 125/250] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:05.808396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0740ba-6e56-4b14-9bd1-5679410c034d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.838848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c39c7-bd3e-4039-8acb-843267a0ecd5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.884475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.885630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.885630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.885896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.887084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.889793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89e56e-3c1e-4bfe-ac2e-fae44fa467f0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.890757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 126/251] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:05.891658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.891828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.892084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.911019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:05.912200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:05.935061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0740ba-6e56-4b14-9bd1-5679410c034d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.974559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.975457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.975735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.976006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.977672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.979499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.984522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 126/252] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:05.984522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.005398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 127/253] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:06.006188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.111574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb71b-f6a8-41cc-982e-298bc7c6ce4e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.130096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc432-4b4d-4db6-b426-9924356828d1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.155354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.156935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.157517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.157985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.159145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=8cb4746ce2e24e059ced9509075e8871) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:06.159600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:06.161255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:06.167384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 127/254] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/role_assignments?user.id=8cb4746ce2e24e059ced9509075e8871&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:06.168757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.169763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.170699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.170981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.171258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/37c6f4a5839e455ab0d34dac58734b45/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.173834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, user_id=37c6f4a5839e455ab0d34dac58734b45, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:06.175148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b442b-a717-4196-a51f-234377bda1f2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:06.212181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 128/255] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:06 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/37c6f4a5839e455ab0d34dac58734b45/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:06.256189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caaee-1b7e-49cb-b02f-996f9aaf21b9 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.256372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caaee-1b7e-49cb-b02f-996f9aaf21b9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.256698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caaee-1b7e-49cb-b02f-996f9aaf21b9 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.258199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 129/256] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:06.265662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac078af-52fc-452a-a800-823caf82222d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.265951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac078af-52fc-452a-a800-823caf82222d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.266230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac078af-52fc-452a-a800-823caf82222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.288281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1ac078af-52fc-452a-a800-823caf82222d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:06.289538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1ac078af-52fc-452a-a800-823caf82222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:06.359448 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdf1-fafb-4185-9d67-fd6b154a8bc8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.408213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.409784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.410211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.410625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.422630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:06.430816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:06.431953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:06.432917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:06.435385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 128/257] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:06.439291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 130/258] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:06.441056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.474090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac078af-52fc-452a-a800-823caf82222d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.595698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119c11-e6d6-4434-8987-58d740668514 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.620358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac078af-52fc-452a-a800-823caf82222d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.642084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.643098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.643553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.644010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.644973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:06.645448 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:06.647018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:06.655685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.656403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 129/259] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:06.659020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.659020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.659020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.669682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.673900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:06.688254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:06.689299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:06.690525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 131/260] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:06.695286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.840407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7a88-ab54-4558-b5cb-017507e3aa09 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.904500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.905416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.905686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.905956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.910162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:06.911644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:06.914165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 130/261] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:06.921990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.940114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5896c-cbfe-4f7a-b0a2-ca76b7d37dfc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.024815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.024815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.024815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.024815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.025228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:07.025228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.025228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.039714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 132/262] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:07.073531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:07.076142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa9685-004c-4532-af9c-c73d6c160b4d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.109636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.110667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.111148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.111627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.181838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.183715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.286306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 131/263] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:07.291573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:07.304004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba1c-fadf-473a-b10b-3f268eddfa89 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.380192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.381113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.381394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.381672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] PATH_INFO: `/v3/users/e4dea44858ae4b4e91850c5e0c2cf635` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.382937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dea44858ae4b4e91850c5e0c2cf635)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.384410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.386415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 133/264] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:07 2022] GET /identity/v3/users/e4dea44858ae4b4e91850c5e0c2cf635 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:07.402512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:07.403107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddff3-6ebe-4eaf-ab5c-194f291fd915 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.436798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.438600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.439411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.439875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.441319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.443057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.444994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 132/265] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:07 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:07.450697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:07.601381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8b6f-06d0-4740-b6d2-98f9687cdc41 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.645493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.646503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.646999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.647460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.666802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2a9-6b15-4365-a975-bec7561704de None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:07.723493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.725632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.757320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:07.757830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:07.758124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:07.758408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:07.759262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=e4dea44858ae4b4e91850c5e0c2cf635) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:07.759580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:07.761065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:07.777725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 133/266] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:07 2022] GET /identity/v3/role_assignments?user.id=e4dea44858ae4b4e91850c5e0c2cf635&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:07.829777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 134/267] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:07.835718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:07.988742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2f38e-0a6f-4b14-8792-863a57eb0a48 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:08.033226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:08.034128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.034411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.034688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.036012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:08.037558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f2663-dde7-4a83-8d53-8b79ade7983a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:08.039716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 134/268] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:07 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:08.047573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:08.163491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a814-a69c-4658-aaec-7fc1f981d8e1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:08.197400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:08.198447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.198921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.199378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.200391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=e4dea44858ae4b4e91850c5e0c2cf635) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:08.200916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:08.202561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58663d9-b1d1-450d-b370-762ba02e7e7b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:08.208679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 135/269] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:08 2022] GET /identity/v3/role_assignments?user.id=e4dea44858ae4b4e91850c5e0c2cf635&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=294f84347b07412085947d751f52f815 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:08.763365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0020dc-3f4e-4a57-8db5-adb8e4458256 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.763898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0020dc-3f4e-4a57-8db5-adb8e4458256 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.763898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0020dc-3f4e-4a57-8db5-adb8e4458256 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.765542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 135/270] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:08.771210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db33c-c547-4ffe-b783-d1b7a4b253b8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.771720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db33c-c547-4ffe-b783-d1b7a4b253b8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.771794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db33c-c547-4ffe-b783-d1b7a4b253b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.794055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c25db33c-c547-4ffe-b783-d1b7a4b253b8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:08.795289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c25db33c-c547-4ffe-b783-d1b7a4b253b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:08.870790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 136/271] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:08.894935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0020dc-3f4e-4a57-8db5-adb8e4458256 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:08.966699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2fed-347a-48b5-b138-2f513eaf00ad None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.966879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2fed-347a-48b5-b138-2f513eaf00ad None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.967405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2fed-347a-48b5-b138-2f513eaf00ad None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.969074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 137/272] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:08.975132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:08.975435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:08.975744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:08.994289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:08.995491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:09.002585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0020dc-3f4e-4a57-8db5-adb8e4458256 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.043846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.045160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.045885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.046345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.047720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.050052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.056595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 136/273] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:09.058555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.072472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 138/274] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:09.089195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.162800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b20b-77bf-40cc-a951-99544eaa8fea None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.198220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.199271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.199738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.200194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.201139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.202823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518964e-1c26-4905-a737-ff8f4f59cb3e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.204094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dd5da-3961-4add-9e33-d16ad1760869 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.227413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 137/275] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:09 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:09.228765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614547a-83ba-4bb8-91f5-dbe79cf5c761 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.229053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614547a-83ba-4bb8-91f5-dbe79cf5c761 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.229327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614547a-83ba-4bb8-91f5-dbe79cf5c761 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.232489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 138/276] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:09.236315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.236968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.237384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.257337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.258417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.258761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.259102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.259332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:09.261009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:09.273512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:09.284459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:09.285513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:09.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 139/277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:09.293211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.353380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 139/278] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:09.375669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.425884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd1ec-e77d-4f04-a481-2cb13b306b36 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.474485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.475684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.475970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.476241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.477089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:09.477391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.478915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.492615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 140/279] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:09.496307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.507443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247b02-a092-428a-b5da-c8040e484faa None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.548617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.549517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.549769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.550041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.563267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:09.571261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:09.572183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:09.573067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 140/280] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:09.579526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.626188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466648eb-44a3-415d-aaee-4a2a9367b9f6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.662457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.663434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.663801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.664148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] PATH_INFO: `/v3/users/7403f8bca9704a24b47f8baebfa8433c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.686543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] RBAC: Authorizing `identity:get_user(user_id=7403f8bca9704a24b47f8baebfa8433c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.688880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88acbb4-0de8-4ce6-a919-a040c4085e63 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.691468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 141/281] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/users/7403f8bca9704a24b47f8baebfa8433c => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:09.694737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb82e-36c4-4732-859f-55b744803f4e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.695020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb82e-36c4-4732-859f-55b744803f4e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.695294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb82e-36c4-4732-859f-55b744803f4e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.697040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 142/282] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:09.699348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb82e-36c4-4732-859f-55b744803f4e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.705098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9768-9ac9-46dd-840a-dd083075fed4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.747859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.748473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.748764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.749033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.749916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:09.750215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.751597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa89145-f760-4787-a2d0-284b2d4a7838 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.762692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 141/283] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:09.764663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.765672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.766457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.786687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:09.787937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:09.819998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb82e-36c4-4732-859f-55b744803f4e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:09.860459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 142/284] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:09.860459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.861002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:09.861915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:09.862413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:09.862892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:09.863918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, user.id=7403f8bca9704a24b47f8baebfa8433c, scope.system=all) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:09.864419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:09.866138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:09.877586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 143/285] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/role_assignments?user.id=7403f8bca9704a24b47f8baebfa8433c&scope.system=all&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:09.889191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:09.996063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716297-4c56-48ca-b53d-341d4d5fe2cc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.036560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.036560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.036560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.036560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.038488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb40f-dc0f-4230-b6c0-f8be8f70c75d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.065485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:10.073481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:10.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:10.075267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:10.075865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.075952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.076590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.076590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] PATH_INFO: `/v3/users/8cb4746ce2e24e059ced9509075e8871` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.077970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=8cb4746ce2e24e059ced9509075e8871)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.079475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.081625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 143/286] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/users/8cb4746ce2e24e059ced9509075e8871 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:10.084657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 144/287] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:10.086729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.090857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.279144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ebc8-02e0-44c2-ab9f-f6073e1b7f3f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.306668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c5b8-8ebb-4f1b-8b65-ebf9d7d8b1e0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.320601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.321282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.321568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.321838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.322588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:10.322891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.324277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.342540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 145/288] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:10.348577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.376274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.377180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.377455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.377724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.382538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.383979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.385725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 144/289] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:10 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:10.396090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.502409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866002-6f67-4327-9868-eb1a1f3d5d3c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.543817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.544755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.545032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.545302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/8cb4746ce2e24e059ced9509075e8871/roles/fa6f32a6915d4618ac45f464f38c8dd0` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.547289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, user_id=8cb4746ce2e24e059ced9509075e8871, role_id=fa6f32a6915d4618ac45f464f38c8dd0)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.548896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.566008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b506d4-3902-4979-8ae5-6c8e90cfc9c8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.579993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 145/290] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:10 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/users/8cb4746ce2e24e059ced9509075e8871/roles/fa6f32a6915d4618ac45f464f38c8dd0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:10.608226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.609368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.609654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.609928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] PATH_INFO: `/v3/users/37c6f4a5839e455ab0d34dac58734b45` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.611324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] RBAC: Authorizing `identity:get_user(user_id=37c6f4a5839e455ab0d34dac58734b45)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.613000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.616814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 146/291] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:10 2022] GET /identity/v3/users/37c6f4a5839e455ab0d34dac58734b45 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:10.620986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.902354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0c4-1a1e-4689-a797-a8f52bf0fadd None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.973859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.974527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.974805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.975076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:11.095832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:11.097771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:11.304014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 146/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:11.309991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:11.440003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc356-a359-4454-934e-9180e4e23615 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:11.485221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:11.486487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:11.486965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:11.487431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:11.491536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:11.493257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2a8d7-6b6a-4ec0-a440-c2f66c1463aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:11.495238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 147/293] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:11 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:11.501363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:11.612686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baea2f-e268-476f-8941-2ccd171046f2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:11.658368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:11.659344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:11.659821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:11.660288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:11.661367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=37c6f4a5839e455ab0d34dac58734b45) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:11.661873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:11.663583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e200-300c-478f-bb59-98639936ec86 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:11.670462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 147/294] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:11 2022] GET /identity/v3/role_assignments?user.id=37c6f4a5839e455ab0d34dac58734b45&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:12.066236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863faf4-92cc-4647-89b6-e5a7d5191ad7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.066938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863faf4-92cc-4647-89b6-e5a7d5191ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.067417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863faf4-92cc-4647-89b6-e5a7d5191ad7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.069546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 148/295] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:12.075417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fd37-ecc1-41ff-9e4e-7f470d457059 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.076381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fd37-ecc1-41ff-9e4e-7f470d457059 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.076896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fd37-ecc1-41ff-9e4e-7f470d457059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.094846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6717fd37-ecc1-41ff-9e4e-7f470d457059 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:12.096402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6717fd37-ecc1-41ff-9e4e-7f470d457059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:12.177637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 148/296] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:12.202320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863faf4-92cc-4647-89b6-e5a7d5191ad7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.311532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863faf4-92cc-4647-89b6-e5a7d5191ad7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.343698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d30a2-8fe1-4f85-9364-6fcadaec2658 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.344602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d30a2-8fe1-4f85-9364-6fcadaec2658 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.345323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d30a2-8fe1-4f85-9364-6fcadaec2658 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.348280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 149/297] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:12.356341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1aec-7172-49fb-bb0e-ac39e1ee0179 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.356921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1aec-7172-49fb-bb0e-ac39e1ee0179 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.357424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1aec-7172-49fb-bb0e-ac39e1ee0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.357593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.358374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.358711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.359002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.362715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:12.362715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:12.363874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 149/298] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:12.369333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.383873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ab3d1aec-7172-49fb-bb0e-ac39e1ee0179 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:12.387443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ab3d1aec-7172-49fb-bb0e-ac39e1ee0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:12.468152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e631dc-1e1e-4d12-923e-3750f3e28d9d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.472881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 150/299] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:12.474075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1a02-208a-42e5-a961-11d479c8ab99 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.474365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1a02-208a-42e5-a961-11d479c8ab99 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.474638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1a02-208a-42e5-a961-11d479c8ab99 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.476468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 151/300] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:12.483171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.483731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.484184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.501164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:12.502345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:12.509039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.509718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.510302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.510302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] PATH_INFO: `/v3/groups` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.510942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:12.512399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:12.528540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 150/301] 10.222.0.49 () {60 vars in 1134 bytes} [Mon May 16 20:23:12 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:23:12.529422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.591990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 152/302] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:12.615280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.641409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab829-ac47-45c5-b72e-d2280842ea9f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.678253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.679473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.679953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.680498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.699756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:12.710092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:12.711184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:12.712019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:12.716547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 151/303] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:12.718865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.727976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d2551-a2b3-44fc-be0b-244d30dd10e1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.777909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.778902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.779187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.779463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.790209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:12.797916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:12.798806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:12.799634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 153/304] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:12.805400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.843001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044826df-8e52-4fc7-bee8-f9a04ab33d9e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.877419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.878390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.878674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.878953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.879709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:12.880017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:12.881447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:12.889717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 152/305] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:12.896173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:12.932758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc8396-3d98-43da-b4b8-5b1ac6744bed None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:12.973404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:12.974786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:12.975220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:12.975637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:12.976559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:12.977008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:12.979225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:12.989750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 154/306] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:12.995487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.002124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9d4d-4038-4f6a-b7a5-c46d511bba22 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.048594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.050118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.050861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.051423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] PATH_INFO: `/v3/users/7403f8bca9704a24b47f8baebfa8433c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.052924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] RBAC: Authorizing `identity:get_user(user_id=7403f8bca9704a24b47f8baebfa8433c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.055354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.057696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 153/307] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/users/7403f8bca9704a24b47f8baebfa8433c => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:13.063430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.121603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f557d-67a5-4aad-b619-6e46c8505e0a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.165757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.167080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.167459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.167831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] PATH_INFO: `/v3/users/dd34d4c3ff9849f4936f45059e460a3e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.169036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da09674-847a-4f2f-81f2-5ba2f82e398b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.186602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] RBAC: Authorizing `identity:get_user(user_id=dd34d4c3ff9849f4936f45059e460a3e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.188775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.190911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 155/308] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:12 2022] GET /identity/v3/users/dd34d4c3ff9849f4936f45059e460a3e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:13.196278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.209593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.210626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.211255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.211538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] PATH_INFO: `/v3/system/users/7403f8bca9704a24b47f8baebfa8433c/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.213489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7403f8bca9704a24b47f8baebfa8433c, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.215179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ada4-0f98-4dd9-a534-5e9b2b477430 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.226704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 154/309] 10.222.0.49 () {58 vars in 1334 bytes} [Mon May 16 20:23:13 2022] PUT /identity/v3/system/users/7403f8bca9704a24b47f8baebfa8433c/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:23:13.227977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5938f6-c573-45c6-8bfc-557d7429a5ab None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.228270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5938f6-c573-45c6-8bfc-557d7429a5ab None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.228569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5938f6-c573-45c6-8bfc-557d7429a5ab None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.234321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 155/310] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:13.237681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.238034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.238285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.274231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:13.276381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:13.326398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1f88-9a3e-4eb8-a694-c339d53272ab None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.368590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 156/311] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:13.369583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.370299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.370576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.370846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.371765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, user.id=dd34d4c3ff9849f4936f45059e460a3e, scope.system=all) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:13.372079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.373853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.386378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 156/312] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 16 20:23:13 2022] GET /identity/v3/role_assignments?user.id=dd34d4c3ff9849f4936f45059e460a3e&scope.system=all&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:13.387562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.499036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67301c6-533e-4b7f-9a92-0c1500d4012c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.538319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.539204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.539486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.539756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.551242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:13.559356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:13.560306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:13.561155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 157/313] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:13.568563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.671620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20b2-2692-44b7-aea6-9134d552915a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.705068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.705741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.706045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.706291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.707051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:13.707356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.708763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.717187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 157/314] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:13.722693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.822198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a289-4dd3-4c10-9108-231421b932ba None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:13.858941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:13.859830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:13.860157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:13.860456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] PATH_INFO: `/v3/users/8cb4746ce2e24e059ced9509075e8871` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:13.861698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] RBAC: Authorizing `identity:get_user(user_id=8cb4746ce2e24e059ced9509075e8871)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:13.863163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:13.865167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 158/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:13 2022] GET /identity/v3/users/8cb4746ce2e24e059ced9509075e8871 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:13.870484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:13.968103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d89a7-a540-4a8d-bce5-06f3d24cdd30 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:14.001682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:14.002349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:14.002629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:14.003268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:14.067949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:14.069439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:14.168554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 158/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:14.170564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:14.272112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4cc70-9c8a-494b-b2ff-17ec8385ff6b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:14.304390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:14.305615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:14.306070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:14.306514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:14.307868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:14.309550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40755657-8552-4ebf-b07f-5ce8faf837c4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:14.316311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 159/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:14 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:14.317860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:14.418647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9945-25f4-4090-bc9f-b2f1ea343430 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:14.454349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:14.455372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:14.455858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:14.456303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:14.457335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, scope.project.id=5b5f54df0de04bb9963494d410e3455b, user.id=8cb4746ce2e24e059ced9509075e8871) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:14.457821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:14.459466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaa452-2462-49d4-b79f-98e9ed740bf3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:14.466016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 159/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:14 2022] GET /identity/v3/role_assignments?user.id=8cb4746ce2e24e059ced9509075e8871&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:14.895643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf85-da56-4b1f-b480-78a2b54e8b68 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:14.896157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf85-da56-4b1f-b480-78a2b54e8b68 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:14.896157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf85-da56-4b1f-b480-78a2b54e8b68 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:14.897691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 160/319] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:14.902839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:14.903130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:14.903393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:14.920894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:14.922110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:14.987835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 160/320] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:15.010199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79bf85-da56-4b1f-b480-78a2b54e8b68 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:15.115001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79bf85-da56-4b1f-b480-78a2b54e8b68 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:15.149680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:15.150485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.150768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.151042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.152228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:15.153721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff2db-527a-4fec-87a2-7d4c71a8825d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:15.155544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 161/321] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:15.161121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:15.257712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347808b4-a4e6-46b5-a531-13546f0681ea None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:15.290763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:15.291430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.291710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.291982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] PATH_INFO: `/v3/groups` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.292727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:15.294157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57a8e0-b79c-44d5-8386-17993f4a36a7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:15.309891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 161/322] 10.222.0.49 () {60 vars in 1134 bytes} [Mon May 16 20:23:15 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:15.560742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328d7a-3d18-45f6-b1de-b1e5873744da None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.560988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328d7a-3d18-45f6-b1de-b1e5873744da None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.561205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328d7a-3d18-45f6-b1de-b1e5873744da None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.562719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 162/323] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:15.568600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.569008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.569290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.587348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:15.588641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:15.625446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae6636-2d58-4b0e-8aa7-f09e7cae8955 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.625866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae6636-2d58-4b0e-8aa7-f09e7cae8955 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.626041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae6636-2d58-4b0e-8aa7-f09e7cae8955 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.627357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 163/324] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:15.633117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.633399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.633675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.651621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:15.655494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:15.668254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 162/325] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:15.690877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:15.737762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 164/326] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:15.760196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:15.816564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587f063-647d-4f70-ac28-50cea164e96b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:15.855596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:15.856420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.856732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.857006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.868424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:15.877497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:15.878815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:15.879632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 163/327] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:15.885192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:15.886714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439e7d-6297-4193-a499-1d5a64f06287 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:15.924144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:15.925817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:15.926297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:15.926767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:15.937908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:15.946155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:15.947090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:15.947921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:15.950682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 165/328] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:15.956580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:16.002994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56de7-5798-4981-a3d3-4671a66f55b1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.040996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.041683 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.041967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.042244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.043022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:16.043332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.044784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.055293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 164/329] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:16.061526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:16.063678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef797-deca-43b6-b586-e4cce52550b7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.099302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.099903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.100188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.100491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.101259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:16.101569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.102980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.116687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 166/330] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:16.117648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:16.179938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153681-f199-4365-9e2f-e845be1e9619 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.228739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204625-9355-4402-947c-a1c3df718ed9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.233303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.234237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.234519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.234797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] PATH_INFO: `/v3/users/7403f8bca9704a24b47f8baebfa8433c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.236041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] RBAC: Authorizing `identity:get_user(user_id=7403f8bca9704a24b47f8baebfa8433c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.237706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.239352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 165/331] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:16 2022] GET /identity/v3/users/7403f8bca9704a24b47f8baebfa8433c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:16.245044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:16.271738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.273151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.273447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.273999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] PATH_INFO: `/v3/users/dd34d4c3ff9849f4936f45059e460a3e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.275473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] RBAC: Authorizing `identity:get_user(user_id=dd34d4c3ff9849f4936f45059e460a3e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.277705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.280080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 167/332] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:16 2022] GET /identity/v3/users/dd34d4c3ff9849f4936f45059e460a3e => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:16.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:16.363427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebda3-0886-4546-bdb3-1f4f44317469 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.407070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b700-620f-4ed5-b191-0f96a22e11f0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:16.431887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.432590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.432873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.433148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.433987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] RBAC: Adding query filter params (role.id=99ac4a09727c4646a782397c7f07e9c3, user.id=7403f8bca9704a24b47f8baebfa8433c, scope.system=all) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:16.434307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.435756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f2070-9eab-4e53-bc0b-54b375dce92b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.442753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:16.443766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:16.444047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:16.444507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] PATH_INFO: `/v3/system/users/dd34d4c3ff9849f4936f45059e460a3e/roles/fa6f32a6915d4618ac45f464f38c8dd0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:16.446037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dd34d4c3ff9849f4936f45059e460a3e, role_id=fa6f32a6915d4618ac45f464f38c8dd0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:16.447434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764088f-0faf-42b9-b71c-88e982517f48 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:16.458340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 168/333] 10.222.0.49 () {58 vars in 1334 bytes} [Mon May 16 20:23:16 2022] PUT /identity/v3/system/users/dd34d4c3ff9849f4936f45059e460a3e/roles/fa6f32a6915d4618ac45f464f38c8dd0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:23:16.459709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 166/334] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 16 20:23:16 2022] GET /identity/v3/role_assignments?user.id=7403f8bca9704a24b47f8baebfa8433c&scope.system=all&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:18.466553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ee83-b3d6-4b09-943e-05c405a4ddc2 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.467256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ee83-b3d6-4b09-943e-05c405a4ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.467256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ee83-b3d6-4b09-943e-05c405a4ddc2 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.468552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 169/335] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:18.474456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.475016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.475016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.492063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:18.497385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:18.557893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431521f-0f4b-467b-839d-85d56fdab009 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.558321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431521f-0f4b-467b-839d-85d56fdab009 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.558718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431521f-0f4b-467b-839d-85d56fdab009 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.562456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 170/336] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:18.567978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.568269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.568589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.602405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:18.603611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:18.608124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 167/337] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:18.645933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:18.763256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 171/338] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:18.792791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:18.829558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd71543-281a-422f-9b1e-64e67380b4d0 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:18.904808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195b3c-922b-423f-9823-835a19234371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:18.905701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195b3c-922b-423f-9823-835a19234371 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.905975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195b3c-922b-423f-9823-835a19234371 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.906415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195b3c-922b-423f-9823-835a19234371 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.911537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb7bc-61eb-4ebd-bcda-b542f2cc184b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:18.941446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62195b3c-922b-423f-9823-835a19234371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-62195b3c-922b-423f-9823-835a19234371 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:18.951386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:18.952642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:18.953521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 168/339] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:18.961545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195b3c-922b-423f-9823-835a19234371 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:18.977191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:18.978275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.978711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.979138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.001436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:19.011461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:19.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:19.013678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:19.025578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 172/340] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:19.029840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:19.175560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195b3c-922b-423f-9823-835a19234371 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:19.235950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a389-cb3a-4a52-817b-1c3c92e9957d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:19.250808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:19.251739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.252163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.252959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.253874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:19.254347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:19.255893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:19.273820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 169/341] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:19.281116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:19.298931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:19.299619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.299897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.300169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.301269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:19.301269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:19.303122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:19.315977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 173/342] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:19.321799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:19.418836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ea799-116f-429d-88c1-719c433dacc0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:19.452782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:19.453726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.454156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.454576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.525475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:19.527601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80ccc-6e88-4836-b871-05a9c8a5000a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:19.529416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc32d-014a-4397-ba94-1333548bba20 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:19.590691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:19.591600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.592026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.592646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.690163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 170/343] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:19.691803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021760-a80c-461b-a013-e8ae4f49ca87 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.692233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021760-a80c-461b-a013-e8ae4f49ca87 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.692675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021760-a80c-461b-a013-e8ae4f49ca87 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.694107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 171/344] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:19.701417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021760-a80c-461b-a013-e8ae4f49ca87 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:19.713581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:19.715259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8af92-8e4f-490d-9ee1-a70b36b9a151 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:19.826515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021760-a80c-461b-a013-e8ae4f49ca87 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:19.827931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 174/345] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:19.830277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.830592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.830879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.850564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:19.851765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:19.867182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:19.868402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.868916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.869402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.870986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:19.872752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f85e36-00ad-412f-a2fe-b3bfdcf26685 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:19.875123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 172/346] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:19.876719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444bb1-a076-47cc-a176-c4f2288ca1b9 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:19.877195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444bb1-a076-47cc-a176-c4f2288ca1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:19.878051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444bb1-a076-47cc-a176-c4f2288ca1b9 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:19.879479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 173/347] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:19.880611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444bb1-a076-47cc-a176-c4f2288ca1b9 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:19.941272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 175/348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:19.942844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.026083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444bb1-a076-47cc-a176-c4f2288ca1b9 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.042512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0209-a97a-41ea-88d8-614800941dfc None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.064270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.065502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.065978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.066409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.069224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.070689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6806-52bf-455c-81ab-7d5985bd7b74 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.072456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 174/349] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.073680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.073926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.074200 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.078726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.079541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.079816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.080087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.086411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.087876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.089885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 176/350] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:19 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.090669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.100355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:20.101608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:20.187014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 175/351] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:20.187962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.210737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd44b-7da3-4297-ae9b-fc95c0dd65b8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.246167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.246995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.247273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.247551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.258893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:20.267130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:20.268084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:20.269375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 177/352] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:20.270269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.306893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4921a-66f8-4dc2-8d0f-19b3d86e059e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.351066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.352913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.352913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.352913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.356080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.356206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d64071-b2c5-41e2-9efe-487a02c895fa None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.357841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 176/353] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.359139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bf874-e03f-4168-9948-90e01e38ef7b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.359430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bf874-e03f-4168-9948-90e01e38ef7b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.359702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bf874-e03f-4168-9948-90e01e38ef7b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.360991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 177/354] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:20.361681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bf874-e03f-4168-9948-90e01e38ef7b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.390750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefc088-89d0-4ebb-85c3-10001bac586a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.426471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.427393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.427824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.428262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.429139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=294f84347b07412085947d751f52f815, scope.project.id=8d64880bd4df407097e717603ec5b713) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:20.429446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.430916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.436352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 178/355] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=294f84347b07412085947d751f52f815 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.437294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.476715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bf874-e03f-4168-9948-90e01e38ef7b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.514600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.515424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.515709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.515984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.527895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-2bdd540a-ae40-4b7e-a067-133ee3fda139 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:20.536875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:20.537850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:20.538711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 178/356] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:20.540201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3138ec-3585-4546-a9ce-dc838d789608 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.540201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3138ec-3585-4546-a9ce-dc838d789608 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.540201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3138ec-3585-4546-a9ce-dc838d789608 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.542331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 179/357] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:20.542331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3138ec-3585-4546-a9ce-dc838d789608 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.556104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d38a6-4ba6-4a16-aa46-59b06e82e9c0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.596404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.597130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.597685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.599110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:20.599419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.605879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757245e-3087-4582-91a9-9ab525990fb8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.614268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 179/358] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.615565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.616377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.616686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.641649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:20.643296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:20.687397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3138ec-3585-4546-a9ce-dc838d789608 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.730755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 180/359] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:20.731623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.735711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.736383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.736716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.736993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.737842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=8d64880bd4df407097e717603ec5b713) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:20.738156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.739628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cdda6-e222-4e70-a6fd-9611c33542be None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.746274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 180/360] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.748360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.748982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.749424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.773255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:20.774489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:20.866684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 181/361] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:20.866684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.886731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c09dd4-b7c0-4bf5-9c07-bd29c8c3c033 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:20.933395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:20.934195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:20.934538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:20.934877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:20.935749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:20.936206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:20.937730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:20.948746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 181/362] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:20.949711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:20.978900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11ccb7-b91a-4d6e-98a2-92d5173d7608 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.033779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.034718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.035161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.035579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.068238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089979-bde4-4b96-acb5-6eb473edbf37 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.103310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.104404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.104859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.105275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.105483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.106873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.116571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:21.125313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:21.126244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:21.127065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:21.134509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 182/363] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:21.135553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.218194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 182/364] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:21.221340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.251290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1967-7091-4c45-8f4c-45c0d25fe26b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.292335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.293089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.293367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.293695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.306597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:21.316131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:21.317314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 183/365] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:21.318378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.336829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99801ddb-127a-4070-8fb1-3aa1a6db5f8d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.380922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.381730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.382080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.382281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] PATH_INFO: `/v3/users/dd34d4c3ff9849f4936f45059e460a3e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.383505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd34d4c3ff9849f4936f45059e460a3e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.385144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.386984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 183/366] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/users/dd34d4c3ff9849f4936f45059e460a3e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.387544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.431376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3acbc-579a-4bf5-a444-ca550cb21a0f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.465570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.466592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.467073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.467563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.468526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:21.469015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.470562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.478936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 184/367] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.480029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.488573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a54d-5f87-45e3-9c14-1eace987dab8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.522218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70455943-c934-4126-b598-fd8e78372060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.523138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455943-c934-4126-b598-fd8e78372060 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.523424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455943-c934-4126-b598-fd8e78372060 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.523698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455943-c934-4126-b598-fd8e78372060 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.524932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70455943-c934-4126-b598-fd8e78372060 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.526388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70455943-c934-4126-b598-fd8e78372060 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.528105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 184/368] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.530078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70455943-c934-4126-b598-fd8e78372060 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.582441 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e6eb-8d52-4986-9283-2bc594b332d7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.615841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.616942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.617425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.617992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.618935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:21.619439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.621046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.628678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70455943-c934-4126-b598-fd8e78372060 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.630864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 185/369] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.631931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.674470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.675982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.676510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.677255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.678582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] RBAC: Adding query filter params (role.id=fa6f32a6915d4618ac45f464f38c8dd0, user.id=dd34d4c3ff9849f4936f45059e460a3e, scope.system=all) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:21.679248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.683286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.700319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 185/370] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/role_assignments?user.id=dd34d4c3ff9849f4936f45059e460a3e&scope.system=all&role.id=fa6f32a6915d4618ac45f464f38c8dd0 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.702283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.766259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54018f-798e-4d81-8667-9a55df952c75 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.806354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.807083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.807326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.807602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.831237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08dd87-fcfd-4b23-a45b-21d651c8468a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:21.874835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:21.876552 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:21.877049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:21.878020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:21.879951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.881656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.884824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 186/371] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:21.885225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:21.886184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:21.886770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:21.999509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 186/372] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:22.001491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.013474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfb772-61e4-4406-ba5e-636d0e8a6f2d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.054282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.054830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.055193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.055537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.125763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683021-8dbc-48ac-aee8-975c065f86aa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.126883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.129066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.164825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.165639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.166018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.166437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.167319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=5b5f54df0de04bb9963494d410e3455b) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:22.167735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.171180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.177361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 187/373] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.178102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.244109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 187/374] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:22.250319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.285833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41fd90-994c-4dc2-8228-833d71778326 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.320507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.321418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.321702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.322047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.324089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.324854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.326990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 188/375] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.336474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.391608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349387ac-d110-4843-abe4-5751a9fbf959 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.451000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.451847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.452129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.452405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] PATH_INFO: `/v3/projects/cd0e31e92b6648feab627c19ac9bf98d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.453961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] RBAC: Authorizing `identity:get_project(project_id=cd0e31e92b6648feab627c19ac9bf98d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.455611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.457774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 188/376] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/projects/cd0e31e92b6648feab627c19ac9bf98d => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.463865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.568091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec560-cd41-4fa7-9a9c-0e6e93f57be2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.570447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0a339-310a-41a9-a27f-3343bda643df None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.610196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.611127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.611419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.611693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] PATH_INFO: `/v3/groups/55454fb1fab449cea6f1e6c78cd16f25` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.625914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] RBAC: Authorizing `identity:get_group(group_id=55454fb1fab449cea6f1e6c78cd16f25)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.626934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.627745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.628795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.629255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.629701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.629808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 189/377] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/groups/55454fb1fab449cea6f1e6c78cd16f25 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.631159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.632818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.634876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 189/378] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.637865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.648479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:22.805352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702c50-9163-441a-a6c1-b4b8ccb9c997 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.844097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8dbb-ddb9-4588-9eb8-0936bb220673 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:22.846354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.847273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.847741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.849145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.850227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=294f84347b07412085947d751f52f815, scope.project.id=5b5f54df0de04bb9963494d410e3455b) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:22.850750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.852421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379adc3-25e4-4a05-9a69-cf1d00d76079 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.861655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 190/379] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=294f84347b07412085947d751f52f815 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:22.915757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:22.916507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.916800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.917090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.917951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] RBAC: Adding query filter params (group.id=55454fb1fab449cea6f1e6c78cd16f25, role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=cd0e31e92b6648feab627c19ac9bf98d) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:22.918271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:22.919740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8df61-20ae-4620-956e-9470256e9f39 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:22.929304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 190/380] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:22 2022] GET /identity/v3/role_assignments?group.id=55454fb1fab449cea6f1e6c78cd16f25&scope.project.id=cd0e31e92b6648feab627c19ac9bf98d&role.id=4f500164fa794f84afa94241394a2b5d => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:23.299004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdab6-3c70-46fc-b22a-1ccb96f99a8d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.299655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdab6-3c70-46fc-b22a-1ccb96f99a8d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.300136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdab6-3c70-46fc-b22a-1ccb96f99a8d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.301971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 191/381] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:23.307434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe57ef-f266-4d56-93c1-0c81301c3fe8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.307945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe57ef-f266-4d56-93c1-0c81301c3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.308407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe57ef-f266-4d56-93c1-0c81301c3fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.326443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4cbe57ef-f266-4d56-93c1-0c81301c3fe8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:23.327970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4cbe57ef-f266-4d56-93c1-0c81301c3fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:23.410363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 191/382] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:23.432924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdab6-3c70-46fc-b22a-1ccb96f99a8d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:23.548133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdab6-3c70-46fc-b22a-1ccb96f99a8d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:23.585207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:23.585949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.586231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.586503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.601881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792e91-7a7f-4f19-a08e-ff863c017d33 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.602855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792e91-7a7f-4f19-a08e-ff863c017d33 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.603190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:23.603572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792e91-7a7f-4f19-a08e-ff863c017d33 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.605595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 192/383] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:23.611962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:23.612148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:23.613064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:23.613864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 192/384] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:23.615441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.615911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.624591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:23.646909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:23.648422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:23.724405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 193/385] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:23.759980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:23.820192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44570-0f3f-46f2-8fdd-f23ba2e4f8bf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:23.878018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:23.879034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.879502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.879959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.880928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:23.881934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:23.883839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:23.899056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 193/386] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:23.901587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7042603-531c-4195-9015-1a4e269d00ea None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:23.910151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:23.974061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:23.974880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.975158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.975429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.001381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:24.009489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:24.010384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:24.011175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 194/387] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:24.016712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.035918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11988-914a-4cda-8673-f4dbb306f40d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.092461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.093335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.093609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.093883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.095825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.097302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.098953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 194/388] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:23 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:24.106023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.185414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729449b-4e4f-4c08-8324-1ccaf2066e25 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.243703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.244384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.244691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.244965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.245713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:24.246019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.247406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.269457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 195/389] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:24.273052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.287177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186838e9-1339-4eef-9c11-b56d29ea9e05 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.341849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.342780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.343048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.343333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.346124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.347588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.349524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 195/390] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:24 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:24.356674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.449115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0b45-974c-4133-bf77-204a8fa98014 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.508388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.509803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.509803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.509803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.510974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.512446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.524481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 196/391] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:24 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:24.525974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.529076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880608b-a8dc-4588-84d4-ba62b1d3df5b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.577647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.578555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.578841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.579120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/groups/f42b0354bb9845f48941140741904c2e/roles/294f84347b07412085947d751f52f815` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.587653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, group_id=f42b0354bb9845f48941140741904c2e, role_id=294f84347b07412085947d751f52f815)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.588951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.615031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 196/392] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 16 20:23:24 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/groups/f42b0354bb9845f48941140741904c2e/roles/294f84347b07412085947d751f52f815 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:24.667738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a1c-dc02-4ecc-96d1-14813081743a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.705264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.706112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.706395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.706666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.707898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.709389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b2ceb-8b80-4a95-bfb9-b652a791fdfd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.716060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 197/393] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:24 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:24.717668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:24.821630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea054-b13e-4175-8569-df167b2c571e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:24.856598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:24.857796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.858080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.858360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713/groups/f42b0354bb9845f48941140741904c2e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.858990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055f2-bf6b-43ee-9dab-cc0471869e58 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.859290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055f2-bf6b-43ee-9dab-cc0471869e58 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.859572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055f2-bf6b-43ee-9dab-cc0471869e58 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.860364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] RBAC: Authorizing `identity:create_grant(project_id=8d64880bd4df407097e717603ec5b713, group_id=f42b0354bb9845f48941140741904c2e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:24.861266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 198/394] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:24.862039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:24.868335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:24.868817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:24.869066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:24.886723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 197/395] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 16 20:23:24 2022] PUT /identity/v3/projects/8d64880bd4df407097e717603ec5b713/groups/f42b0354bb9845f48941140741904c2e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:24.891990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:24.893232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:24.968426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 199/396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:24.991647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.104570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1eda-f5fc-44e4-945b-6fb8654f00fa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.142135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.142958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.143241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.143516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.158983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:25.166902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:25.167821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:25.169119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 198/397] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:25.174500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.310915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcf523-7882-4928-a88d-9ee8b5a83ff9 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.355937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.356647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.356933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.357210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.358047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] RBAC: Adding query filter params (name=member) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:25.358358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:25.359742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:25.368846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 200/398] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:25.374380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.510141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c7c4-0252-4925-ba2b-f630a7bc5d9f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.555951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.556846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.557129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.557400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.558588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:25.560044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8af8d-8a0d-423f-8781-64c1f82e07d5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:25.562224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 199/399] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:25 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:25.567721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.676724 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6b9e-8a56-47ba-8b5c-2faf4a0b981b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.677449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6b9e-8a56-47ba-8b5c-2faf4a0b981b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.677953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6b9e-8a56-47ba-8b5c-2faf4a0b981b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.680766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 200/400] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:25.685064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.685633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.686102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.691843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb00d6-e196-49b6-8954-f12ae1db737c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.717368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:25.718928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:25.734512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.735400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.735682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.735958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.738953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:25.740429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:25.744935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 201/401] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:25 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:25.752205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.874840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 201/402] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:25.881187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69992-4842-45ed-a296-1a257d43b74f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.913231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.919339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.920343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.921430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.921715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/groups/f42b0354bb9845f48941140741904c2e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.930746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, group_id=f42b0354bb9845f48941140741904c2e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:25.932214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:25.961847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 202/403] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 16 20:23:25 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/groups/f42b0354bb9845f48941140741904c2e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:26.067532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d9b38-81cb-4a1f-9df0-2771a54b7561 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.112505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.113350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.113635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.113910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.133616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3d4382d9-e2b8-4cb9-b98a-cc3a54c34468 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:26.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:26.144419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:26.146405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 202/404] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:26.149956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.172793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4ecba-db29-47ec-9b09-3229c0d71f86 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.173104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4ecba-db29-47ec-9b09-3229c0d71f86 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.173340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4ecba-db29-47ec-9b09-3229c0d71f86 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.174978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 203/405] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:26.189274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.189578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.189820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.209622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:26.210819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:26.274048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0b58-ce7a-40db-ae0f-a7bf29f8ca32 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.315118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 204/406] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:26.322019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.322714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.322996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.323273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.324032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:26.324339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:26.325753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:26.336602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.356420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 203/407] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:26.370447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.514775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fce7c-7064-4e15-beca-b1a8d82ebf7e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.556840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321761-5359-4058-97e0-56cebe6cb551 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.578624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.579802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.581068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.581539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.600452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:26.610391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:26.611328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:26.614294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 205/408] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:26.617334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.624533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.626525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.627374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.627855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.629281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:26.630930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:26.633113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 204/409] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:26.638044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.745355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd556953-03d1-4263-bd05-84ccd53134c3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.805477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.807159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.812845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.813143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.814475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:26.815939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:26.818006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 205/410] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:26.825377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:26.843574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b595f-c6b4-4070-a9ba-6573db752e5b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:26.879904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:26.881617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:26.882224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:26.882692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:26.883831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:26.884344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:26.885949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:26.895658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 206/411] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:26.900774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:27.010064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a6c8-4de5-40ff-b7dd-884a4420c650 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:27.046147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:27.047379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.047875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.048338 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] PATH_INFO: `/v3/groups/55454fb1fab449cea6f1e6c78cd16f25` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.050159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] RBAC: Authorizing `identity:get_group(group_id=55454fb1fab449cea6f1e6c78cd16f25)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:27.051972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:27.054347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 207/412] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:26 2022] GET /identity/v3/groups/55454fb1fab449cea6f1e6c78cd16f25 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:27.061415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:27.085957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c5ff-1eeb-4d45-a94f-f3133e2f65aa None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:27.136847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:27.138571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.138571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.138782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b/groups/f42b0354bb9845f48941140741904c2e/roles/294f84347b07412085947d751f52f815` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.141044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f54df0de04bb9963494d410e3455b, group_id=f42b0354bb9845f48941140741904c2e, role_id=294f84347b07412085947d751f52f815)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:27.142501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:27.164005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 206/413] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 16 20:23:26 2022] PUT /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b/groups/f42b0354bb9845f48941140741904c2e/roles/294f84347b07412085947d751f52f815 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:27.215838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d0df-d71e-4f67-97bf-a5eb477b7c0d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:27.254419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:27.255339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.255615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.255941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] PATH_INFO: `/v3/projects/cd0e31e92b6648feab627c19ac9bf98d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.257270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd0e31e92b6648feab627c19ac9bf98d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:27.258808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54530c41-d2aa-4e85-8e11-3ff408369db7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:27.260896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 208/414] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:27 2022] GET /identity/v3/projects/cd0e31e92b6648feab627c19ac9bf98d => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:27.266775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:27.385765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b28d-7b3a-497e-b291-25db5b950660 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:27.426813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:27.427724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.427999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.428269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] PATH_INFO: `/v3/projects/cd0e31e92b6648feab627c19ac9bf98d/groups/55454fb1fab449cea6f1e6c78cd16f25/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.434207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] RBAC: Authorizing `identity:create_grant(project_id=cd0e31e92b6648feab627c19ac9bf98d, group_id=55454fb1fab449cea6f1e6c78cd16f25, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:27.435876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c584d9-e445-4173-a1d5-0dc2a725a12f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:27.464339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 207/415] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 16 20:23:27 2022] PUT /identity/v3/projects/cd0e31e92b6648feab627c19ac9bf98d/groups/55454fb1fab449cea6f1e6c78cd16f25/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:27.627658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c587-c7bc-4aea-a7b4-ab8d7c41db44 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.628033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c587-c7bc-4aea-a7b4-ab8d7c41db44 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.628196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395c587-c7bc-4aea-a7b4-ab8d7c41db44 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.629780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 209/416] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:27.638948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.639241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.639393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.659800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:27.661012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:27.684302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c481-894a-49ed-9db3-41434e0a936b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.685042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c481-894a-49ed-9db3-41434e0a936b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.685665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c481-894a-49ed-9db3-41434e0a936b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.689003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 210/417] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:27.693688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:27.694215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:27.694687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:27.718431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:27.719090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:27.739337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 208/418] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:27.776068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:27.813599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 211/419] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:27.864732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:27.927148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb9d9-d09e-48a6-a570-42e1c905bb95 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:27.978078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa0f5-b18c-43d2-8810-2ba9b7fbb502 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.001177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.002407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.002655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.002924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.015398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.016420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.016731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.017007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.024180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:28.027976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:28.032428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:28.033336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:28.034148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 209/420] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:28.035855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:28.036895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:28.037903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:28.039570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 212/421] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:28.043878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.045779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.218921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a2de-2201-42e4-8114-1310c47f0ede None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.240070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3133-3f93-4f0c-b578-cab125611e05 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.268722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.269806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.270283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.270751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.271724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:28.272237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.273894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.292593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 210/422] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:28.298925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.317697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.318737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.319295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.319756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.320780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:28.321278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.322856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.338633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 213/423] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:28.348354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.492106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc695c4-8094-4177-96e0-e7177596f856 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.507911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8131-e160-4dad-875e-fe4f73ea55e0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.525899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.526564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.526849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.527128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.541354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.542005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.542288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.542560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.597364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.598799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fbf50-625b-455a-a031-99eefbd6c979 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.609552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.611010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.705354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 211/424] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:28.706411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 214/425] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:28.707311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902689-b8e8-47b6-ba87-e870e8fbd9cb None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.707600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902689-b8e8-47b6-ba87-e870e8fbd9cb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.707877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902689-b8e8-47b6-ba87-e870e8fbd9cb None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.709906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 212/426] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:28.711065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.714193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6902689-b8e8-47b6-ba87-e870e8fbd9cb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.810086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d459d4-4aa0-47b7-a15d-ed0205ad44f4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.816306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6902689-b8e8-47b6-ba87-e870e8fbd9cb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:28.845406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.846560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.847007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.847483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.848931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.850634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff351bbd-63ae-4137-94dc-684e96e34220 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.857366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:28.857366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.857366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.857366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] PATH_INFO: `/v3/projects/8d64880bd4df407097e717603ec5b713` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.857707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] RBAC: Authorizing `identity:get_project(project_id=8d64880bd4df407097e717603ec5b713)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:28.857707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:28.857976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 215/427] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:28.858974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 213/428] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/projects/8d64880bd4df407097e717603ec5b713 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:28.859681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:28.859781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.860314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:28.860769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:28.878130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:28.879639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:28.945087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 216/429] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:28.946213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:28.976577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cccdd5-cc57-4a80-854d-7b9e0b0ada0c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.011338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.012500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.012714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.012991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.014216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.015672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.017331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 214/430] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:29.018087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.055459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878860c-01b9-47a8-9e47-b9874a2b9518 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.088592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.089772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.090218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.090657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.092127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.093791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.095607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 217/431] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:28 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:29.096612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.113490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b79ff-e047-405b-b02f-960bd07757ae None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.146282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.147182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.147467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.148046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.157674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:29.165291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:29.166175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:29.167001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 215/432] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:29.167685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.196517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f2c9d-69a0-439e-b7aa-10f85f0dda66 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.230162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.231105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.231590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.231991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.233013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=294f84347b07412085947d751f52f815, scope.project.id=8d64880bd4df407097e717603ec5b713) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:29.233461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.235031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.241141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 218/433] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=294f84347b07412085947d751f52f815 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:29.242116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.268165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83becc-c9b0-46ed-8f1f-f6181e7646e1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.303418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.304100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.304568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.304750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.305716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=8d64880bd4df407097e717603ec5b713) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:29.305910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.307376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.313766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 216/434] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=8d64880bd4df407097e717603ec5b713&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:29.352109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f0c-29e3-4b1f-9e5a-6d46de10420b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.396885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.397962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.398457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.398920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.399961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:29.400505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.402235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.412987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 219/435] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:29.421740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.565967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d85cf7-a87c-4ede-a261-396432657b87 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.603479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.604061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.604343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.604648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.675996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.677616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.775718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 217/436] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:29.781240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.894327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588444d-cc28-48c0-b812-14f365d75a4f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.930808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.931706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.931995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.932256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.933507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.934977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840091f-6f48-4fcc-bfdd-0a0d775df67e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.937167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 220/437] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:29.943009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.000741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ab2d-86ae-4f33-bffa-41275e740512 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.001091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ab2d-86ae-4f33-bffa-41275e740512 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.001297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ab2d-86ae-4f33-bffa-41275e740512 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.003316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 221/438] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:30.008361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd901b-db2e-4c61-9c62-9824095c3327 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.008716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd901b-db2e-4c61-9c62-9824095c3327 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.009001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd901b-db2e-4c61-9c62-9824095c3327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.026136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6ccd901b-db2e-4c61-9c62-9824095c3327 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:30.027634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6ccd901b-db2e-4c61-9c62-9824095c3327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:30.049627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e731-ed35-418c-9082-b82276f0c355 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.086409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.087283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.087567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.087841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.089051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.090500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab0bef-47c2-43e0-8bcc-13c760824a1e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.092204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 218/439] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:30.094426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98013-f0d0-478c-bad0-ff46196e5235 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.094711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98013-f0d0-478c-bad0-ff46196e5235 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.094983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98013-f0d0-478c-bad0-ff46196e5235 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.096532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 219/440] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:30.099102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b98013-f0d0-478c-bad0-ff46196e5235 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.100567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 222/441] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:30.102459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.102750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.103029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.119035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:30.120214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:30.181872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 223/442] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:30.182694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.198132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b98013-f0d0-478c-bad0-ff46196e5235 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.232074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.232802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.233085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.233361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.234201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=99ac4a09727c4646a782397c7f07e9c3, scope.project.id=5b5f54df0de04bb9963494d410e3455b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:30.234512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.235954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.241747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 220/443] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=99ac4a09727c4646a782397c7f07e9c3 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:30.242542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.286155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d121-c0e2-4e30-a040-300e2000be0d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.320978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.321817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.322103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.322372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.334045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:30.342384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:30.343375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:30.349583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:30.350230 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539d448-334e-4d3d-88bf-505f854ad8bf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.350315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 224/444] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:30.350315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.379560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.380376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.380700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.380974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.392162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:30.400056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:30.401141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:30.402179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 221/445] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:30.409957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.464749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325feb2-fd44-4543-9b85-941ceecbb7fd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.503670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.504350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.504686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.504955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.505714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:30.506013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.507472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.514751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003787a-4797-47e6-8801-e753aa111afb None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.515904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 225/446] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:30.521598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.550786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.553369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.553649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.553920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.554684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:30.554987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.556374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.566659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 222/447] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:30.572533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.631043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b671-d918-4bf2-a5e5-6e478f81b75f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.662847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.663499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.663784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.664061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.677823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09234-7184-4ddb-b07d-fd0d3368bff9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.709905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.710553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.710835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.711108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.727838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.729289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.775951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.777434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.820516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 226/448] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:30.826162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.876197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 223/449] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:30.882213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.916311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ceb9-4039-45af-9526-2f6757349948 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:30.947908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:30.948791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:30.949070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:30.949341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] PATH_INFO: `/v3/projects/5b5f54df0de04bb9963494d410e3455b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:30.950512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] RBAC: Authorizing `identity:get_project(project_id=5b5f54df0de04bb9963494d410e3455b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:30.951991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:30.953727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 227/450] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/projects/5b5f54df0de04bb9963494d410e3455b => generated 302 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:30.959471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:30.974373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666562-39b2-4360-929f-4cbd30480222 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:31.006178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:31.006975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.007246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.007517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] PATH_INFO: `/v3/projects/cd0e31e92b6648feab627c19ac9bf98d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.008729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd0e31e92b6648feab627c19ac9bf98d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:31.010157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:31.011827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 224/451] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/projects/cd0e31e92b6648feab627c19ac9bf98d => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:31.017444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:31.056168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254956-304c-49b0-b7e4-88842de0f0af None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:31.091439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:31.092293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.092622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.092898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] PATH_INFO: `/v3/groups/f42b0354bb9845f48941140741904c2e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.094124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] RBAC: Authorizing `identity:get_group(group_id=f42b0354bb9845f48941140741904c2e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:31.095573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:31.097465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 228/452] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:30 2022] GET /identity/v3/groups/f42b0354bb9845f48941140741904c2e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:31.103074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:31.113387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c613e-06f2-41fc-ac95-07031758e1d2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:31.146746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:31.147600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.147874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.148142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] PATH_INFO: `/v3/groups/55454fb1fab449cea6f1e6c78cd16f25` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.149378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] RBAC: Authorizing `identity:get_group(group_id=55454fb1fab449cea6f1e6c78cd16f25)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:31.150808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:31.152412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 225/453] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 16 20:23:31 2022] GET /identity/v3/groups/55454fb1fab449cea6f1e6c78cd16f25 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:31.158259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:31.197186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99104c6d-41e5-4281-8781-97c3a4d88db0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:31.231951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:31.232673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.232962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.233233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.234063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] RBAC: Adding query filter params (group.id=f42b0354bb9845f48941140741904c2e, role.id=294f84347b07412085947d751f52f815, scope.project.id=5b5f54df0de04bb9963494d410e3455b) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:31.234372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:31.235810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0509-08e1-4e41-aa36-41fd3612b887 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:31.241390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 229/454] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:31 2022] GET /identity/v3/role_assignments?group.id=f42b0354bb9845f48941140741904c2e&scope.project.id=5b5f54df0de04bb9963494d410e3455b&role.id=294f84347b07412085947d751f52f815 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:31.249732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb9271-e230-407f-bcf0-ef2db4883ea5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:31.286551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:31.287136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.287419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.287676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.288557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] RBAC: Adding query filter params (group.id=55454fb1fab449cea6f1e6c78cd16f25, role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=cd0e31e92b6648feab627c19ac9bf98d) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:31.288867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:31.290325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ee84d-b135-4cde-8d60-4a81ee5b6680 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:31.296983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 226/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 16 20:23:31 2022] GET /identity/v3/role_assignments?group.id=55454fb1fab449cea6f1e6c78cd16f25&scope.project.id=cd0e31e92b6648feab627c19ac9bf98d&role.id=4f500164fa794f84afa94241394a2b5d => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:34.185658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf704c-f554-4871-a911-87905615a6ee None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.186227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf704c-f554-4871-a911-87905615a6ee None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.186227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf704c-f554-4871-a911-87905615a6ee None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.187950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 230/456] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:34.194062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.194558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.194633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.217422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:34.218625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:34.264224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee35d-335d-4581-94d7-672588e80840 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.264807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee35d-335d-4581-94d7-672588e80840 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.265258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee35d-335d-4581-94d7-672588e80840 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.267100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 231/457] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:34.272601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.273152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.273621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.291217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:34.292787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:34.314342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 227/458] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:34.360105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 232/459] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:34.362165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:34.384653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:34.481020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb51f0-a11b-4477-85b9-c017e65de667 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:34.517377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:34.519643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.525203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.525847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.540781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:34.542718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:34.562294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:34.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:34.564145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:34.564145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:34.564145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:34.564145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:34.566413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 233/460] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:34.572470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:34.596058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dce4d-11bf-45c5-869e-ce5c6fa6084b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:34.683990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd44a-5112-4ee2-aaaf-4ea12f9d696a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:34.693712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:34.694545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.694832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.695112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.717561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:34.719050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:34.719426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:34.720311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.720815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.721285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.722220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:34.722717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:34.724288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcb851-d120-4c32-be1b-953c1d5531cb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:34.736884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 234/461] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:34.738374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ef84-2384-43c9-9173-c01385d9c13f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.738793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ef84-2384-43c9-9173-c01385d9c13f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.739213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ef84-2384-43c9-9173-c01385d9c13f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.740812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 235/462] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:34.742000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535b2-3173-46a6-9b0d-8eb312bcc712 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.742413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535b2-3173-46a6-9b0d-8eb312bcc712 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.742813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e535b2-3173-46a6-9b0d-8eb312bcc712 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:34.743327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:34.744168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:34.745089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:34.745089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:34.745089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:34.745089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:34.746164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 236/463] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:34.747405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12690-1e4e-47bb-80e2-42aa426daf6d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.747636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 228/464] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:34.747731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12690-1e4e-47bb-80e2-42aa426daf6d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.748130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12690-1e4e-47bb-80e2-42aa426daf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.749079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:34.766937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-44c12690-1e4e-47bb-80e2-42aa426daf6d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:34.768113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-44c12690-1e4e-47bb-80e2-42aa426daf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:34.832234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 237/465] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:34.833826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.834109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.834376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.853568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5311-b416-40ca-bae2-d34941b84a32 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:34.854087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:34.855399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:34.887408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:34.888155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:34.888465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:34.888731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:34.889429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:34.890882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:34.910961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 229/466] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:34 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:34.912081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:34.930548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 238/467] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:34.931794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.045952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bee49-29e2-491f-99dc-200bc8e6bdda None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.052545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aac0-a465-4948-a6cc-ceb7c3fc30fd None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.082914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.084056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.084547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.084992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.089697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.090408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.090691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.090968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.091846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:35.092154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.093621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.098233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.100065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.112088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 230/468] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:35.113007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:35.120187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:35.121197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:35.122080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:35.122080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:35.122080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:35.122080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.129199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 239/469] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:35.130419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.241301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d5ca-3ca3-4726-8607-71a956dacc44 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.251737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6a0b-acd4-4c73-ab16-b89dedcd40e5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.283531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.284704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.284815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.285247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.285456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.285673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.286051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.286619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.287483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.289093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.295764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.297915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.313929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 240/470] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:35 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:35.315112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:35.324043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:35.325242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:35.326278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:35.326278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:35.326278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:35.326278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:35.328005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 231/471] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:35.334475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.434072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caad4d-274e-4d61-a54a-a24be741101c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.477225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c90d-f035-4eb9-a283-62adcb0b76e0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.477438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.478013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.478298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.478576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.479328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:35.479628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.482274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536644-c82c-466f-ab34-bb72dfb537ff None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.497930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 241/472] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:35.505094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd38-4b09-49c0-b3b2-e42577416060 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.505373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd38-4b09-49c0-b3b2-e42577416060 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.506029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd38-4b09-49c0-b3b2-e42577416060 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.507844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 242/473] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:35.508832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159edd38-4b09-49c0-b3b2-e42577416060 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.525987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.526954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.527379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.527822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.528806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:35.529257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.530814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ae72-a1ca-4cbe-b91d-895acb238d82 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.548208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 232/474] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:35.549488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.549774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.550052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.575263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:35.577079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:35.638682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159edd38-4b09-49c0-b3b2-e42577416060 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.658570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 233/475] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:35.659422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.684377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.685164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.685438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.685731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.686435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.687868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.716810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 243/476] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:35 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:35.717856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:35.777080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f6f7-f3d8-474f-9fb4-fb191268f55b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.813078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.814204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.814703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.815179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.816084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.817808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.847521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ccfe-6ca9-423c-9b31-ce82cfbef7f5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:35.859434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 234/477] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:35 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:35.888940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:35.889703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:35.889985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:35.890259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:35.891064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:35.892688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:35.901060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.sql.core [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:23:35.901060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 20:23:35.901060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [parameters: {'id': '659fcb70111d40f4b9477f66e01c2584', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 20:23:35.901060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 20:23:35.919439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return ref.to_dict() May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:23:35.920394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application yield resource May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise self.value May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application session.commit() May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:23:35.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.flush() May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application compat.raise_( May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:23:35.922285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:23:35.923200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:23:35.924132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [parameters: {'id': '659fcb70111d40f4b9477f66e01c2584', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:35.925023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 20:23:35.925859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:35.926722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 244/478] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 16 20:23:35 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:35.937264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:36.064292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b43dc-e60e-48ac-9baa-2bab5d6a68bc None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:36.101609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:36.102817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:36.103299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:36.103770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:36.115323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-87a2058b-7428-491c-ab98-e54758ac8e4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:36.124033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:36.124961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:23:36.125776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:36.128897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 235/479] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:36.134889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:36.242222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03e98-07d1-42c9-9ce6-729123830975 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:36.282574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:36.283326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:36.283534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:36.283818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:36.284605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:36.284909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:36.286298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7ce4b-0857-484a-a61d-b567036e0e72 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:36.295035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 245/480] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:37.593274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279b7a-3c3b-4403-85ef-db40fbf11813 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:37.594316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279b7a-3c3b-4403-85ef-db40fbf11813 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:37.594824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279b7a-3c3b-4403-85ef-db40fbf11813 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:37.596655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 236/481] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:37.602519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:37.603368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:37.603841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:37.621274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:37.622826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:37.695593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 246/482] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:37.718395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d279b7a-3c3b-4403-85ef-db40fbf11813 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:37.831667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d279b7a-3c3b-4403-85ef-db40fbf11813 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:37.864698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:37.865436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:37.865714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:37.865995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:37.876793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:37.884571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:37.885470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:37.886271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 237/483] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:37.891948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:37.992298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971025b-98b5-4cd2-a2e9-0b7774acfb4e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.031524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.032219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.032517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.032795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.033558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:38.033863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.035242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8cc54-d7fc-49bb-b850-051f2db910c7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.043971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 247/484] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:38.049510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.196391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdfc2b-abe7-4b4c-859a-ebef1dfb5768 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.240924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.241734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.242014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.242292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.260681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421bb8-eb66-44b6-afa6-4eeabd07d999 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.261076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421bb8-eb66-44b6-afa6-4eeabd07d999 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.261252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421bb8-eb66-44b6-afa6-4eeabd07d999 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.264098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 248/485] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:38.265588 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.267155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.268345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.268704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.268983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:38.287859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:38.290018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:38.292144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:38.292144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:38.292144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:38.292144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:38.295751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 238/486] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:38.299590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.307019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:38.308263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:38.400601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04898f4-8225-40c0-8a26-d3fc1dfcd6a0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.436070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.436773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.437062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.437336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.438072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:38.438378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.439824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.447238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 249/487] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:38.452257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 239/488] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:38.457799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.491193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.630358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb506b5a-6cd6-4047-98ef-2e371ca5ca24 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.676558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928089a-5ae4-4a1f-abd8-840ad3bcb1e6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.682361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.683452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.683932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.684398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.692529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.694294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-71ed2073-ea7f-40d6-9150-8f5f3bb7eade None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:38.710626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:38.711571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:38.712915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:38.713467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.713467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.713467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.713467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.715554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 250/489] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:38.721412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052c396-16d2-4262-86be-c216b64d678c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.722045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052c396-16d2-4262-86be-c216b64d678c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.722221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:38.722729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052c396-16d2-4262-86be-c216b64d678c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.724559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 251/490] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:38.725479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052c396-16d2-4262-86be-c216b64d678c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-efa9a322-819b-43b1-a8f4-5f441a107f70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:38.733041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:38.733999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:38.734818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 240/491] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:38.735998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885e08-8566-4307-856d-dacb3735b112 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.735998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885e08-8566-4307-856d-dacb3735b112 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.736147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885e08-8566-4307-856d-dacb3735b112 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.737696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 241/492] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:38.741544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.741895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.742168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.758701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:38.760067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:38.825619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 242/493] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:38.836652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:38.849196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052c396-16d2-4262-86be-c216b64d678c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.886357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.887032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.887311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.887585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.888427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:38.888841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.890212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03040232-807e-44d4-a34f-7d7ef851e13f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.920079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40b56d-cd9f-419f-8be4-74e06a8aa296 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:38.929501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 252/494] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:38.929501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.929501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.929501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.944954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:38.946153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:38.957618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:38.958308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:38.958593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:38.958871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:38.959667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:38.960040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:38.961636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:38.970073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 243/495] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:38.970948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.017315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 253/496] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:39.017999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.079227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038f71-07dc-4a39-a0ef-8ce178626f05 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.111235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.112034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.112315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.112630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.115566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caeb7a-ecb1-47b4-961d-e116fdd5a7ff None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.122264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:39.130248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.131139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:39.131958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 244/497] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.133229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.152283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.152992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.153306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.153584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.220747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.222158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.236492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7357958-1997-4ae6-9f08-ce6d8edef292 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.267825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.268674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.268957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.269238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.279578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.281070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:39.297755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.298702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 245/498] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.300260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.323018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 254/499] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:39.323018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.395674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2e-a508-42ec-b950-96560495f81c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.410939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f013b5-5ec4-41af-ac5f-2fbc3bc90933 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.428986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.429775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.430055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.430329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.440418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:39.446547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.447212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.447490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.447755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-fe1905a9-b2a0-4c79-a377-9912b6e18c82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:39.448073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.449013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:39.449847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:39.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:39.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.450636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 246/500] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.450715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.450784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065482-94a1-4edf-8f03-5f4d8e8b537c None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.450784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065482-94a1-4edf-8f03-5f4d8e8b537c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.451240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065482-94a1-4edf-8f03-5f4d8e8b537c None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.452558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 247/501] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:39.453029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065482-94a1-4edf-8f03-5f4d8e8b537c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.466216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 255/502] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:39.466216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.551502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065482-94a1-4edf-8f03-5f4d8e8b537c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.555393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204951-2597-4d89-85fd-2f7d89674d66 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.582984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.583636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.583921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.584190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.584952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:39.585253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.586640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.587076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.587866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.588143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.588410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.597274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 248/503] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:39.598049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.598584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.600024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7a5edd47-eaa5-4bd7-87a6-4cfe6df72886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:39.617433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.618339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.619209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:39.619209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:39.619209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.619209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:39.619209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 256/504] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.619787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.620044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.620320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.636822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:39.638273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:39.692563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7646c-2356-49fc-8ce2-c5fcb03c0f8a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.712591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 257/505] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:39.712591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.724498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.725169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.725444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.725715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.726456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:39.726755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.728117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.736332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 249/506] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:39.737150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.805327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29665d-0dde-4f08-9384-0ff6b3238bd2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.832399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834707b2-e381-4883-9221-9f0b7f62f58a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.838215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.839010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.839288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.839558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.849709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.851184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.865320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:39.866112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:39.866395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:39.866659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:39.868484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.869403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.870276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:39.870276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:39.870276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:39.870276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:39.872821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 258/507] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.873511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.874715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:39.876546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:39.891692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:39.892673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:39.893612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 250/508] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:39.894175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:39.973443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521dccd-6bae-48a4-ac5d-ad15d347ff16 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:39.990834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c210f1b-63be-4609-b1c7-da45deb73c58 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.005617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.006304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.006557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.006833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.007551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.007856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.009280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.020089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 259/509] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.020899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.023096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.023890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.024171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.024450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.034573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.036074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:40.052410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:40.053313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:40.054173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:40.054173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:40.054173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:40.054173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:40.054173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 251/510] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:40.054434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.118763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db52566-b5a9-46e6-af30-5a97daaa9ef4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.146454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b9c7-7eed-4a74-8a8f-5176ef0ab79d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.151612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.152397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.152700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.152971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.163028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.164487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.179122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.179775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.180066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.180344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:40.180847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:40.181642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:40.182506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:40.182506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:40.182506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:40.182506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:40.182723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.182723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.182843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 260/511] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:40.182906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.182970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.197317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 252/512] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.198121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.278619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70bcc2-a7cb-4d68-9340-50d6139fe94c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.290965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f70de9-d0ae-4a62-b0a3-41e16399af4b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.311216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.311877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.312161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.312456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.313298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.313608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.315045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.323963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.324780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.325088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.325365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.331429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 261/513] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.331848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.332217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.333306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:40.347454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:40.348356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:40.349248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:40.352734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 253/514] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:40.353447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.427602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739388-7314-48c9-bc24-cca495e314f8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.445597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613260fb-dd54-49df-9642-cd8b6deb0391 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.459259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.459916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.460194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.460484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.461198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.461529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.462902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.473648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 262/515] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.474421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.477188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.477849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.478287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.478386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.479102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.479404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.480810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.491677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 254/516] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.492465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.566642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59405b92-6b31-4999-bf6c-1b217296cc00 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.584073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1a49-dbc7-4983-96c3-823d9743b15a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.598962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.599748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.600026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.600292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.607560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.609058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.615959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.616634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.616915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.617190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:40.622960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:40.623817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:40.624730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 263/517] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:40.625296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.680924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.682330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.722481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1ec3-0b80-491e-8e79-0715a77e4ca2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.755558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.756251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.756552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.756827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.757612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:40.757919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.759356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.776443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 264/518] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:40.781092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 255/519] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:40.781551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.781629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.871910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99066f-257c-4695-a4bb-afd7eea7d307 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.874459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe72b-e8fa-453c-a9ce-1e9ba1f17f37 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:40.905635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.906352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.906632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.906943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.907534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:40.907650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.908326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:40.908684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:40.908958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:40.909100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.915743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:40.917223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:40.929308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 265/520] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:40 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:40.930110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:40.931617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:40.932540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:40.933534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 256/521] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:40.934107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.043834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0e64-6da1-4f86-bfd1-c32f4775fd48 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.047007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace60f9-5c5b-4968-82bc-e9cf392788df None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.080912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.081631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.081937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.082209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.083075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:41.083398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.084007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.084733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.084920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.085013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.085265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.086113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:41.086425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.087883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.104484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 257/522] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:41.104484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.121154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 266/523] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:41.122202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.242619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c0ff-bbf0-4df5-9437-ed23d071dccf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.243173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6486e-7313-490f-9389-e11483144ed1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.288014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.288234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.288985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.289271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.289554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.289680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.290077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.290400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:41.290645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.290749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.292248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.304691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.307147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.314573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 267/524] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:41.319815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:41.335303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:41.336404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:41.337547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:41.337547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:41.337547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.337547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:41.340226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 258/525] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:41.346414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.441953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79acc86-97a6-49ed-be28-97f21d23d3b8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.447104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806d11b-f50b-4aad-9e06-336c24c471d0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.480315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.481231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.481501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.481776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.495429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.496922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.497487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.497938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.560652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.562752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.579398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.582013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.671409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 268/526] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:41.672336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.690671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 259/527] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:41.691877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.769569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b881-b24c-4065-8a37-03426152da64 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.788384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805064a-d566-4f3c-a1b0-ff466a50937f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.803587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.804266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.804580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.804860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.805585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:41.805951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.807393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.823250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 269/528] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:41.823250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.829836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.830867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.830990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.831165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.841695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.843217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:41.861071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:41.861996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:41.862842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:41.862842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:41.862842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.862842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:41.867182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 260/529] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:41.868197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:41.927543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667e25-ed0f-4841-9198-a32cef1ae4bd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.961487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:41.962351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:41.962710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:41.962993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:41.974448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:41.976111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:41.984128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea3c-a081-4dae-9372-0e5194d4fb32 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:41.993625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:41.994490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:41.995339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:41.995339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:41.995339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:41.995339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:41.999613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 270/530] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:42.000421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.020614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.021698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.022180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.022653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.029512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.031157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:42.045431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:42.046305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.047305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:42.054319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 261/531] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:42.055377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.098475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5484-783e-4c72-9664-1350eaa0449f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.133881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.134561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.134841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.135117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.135848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.136153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.137673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.154304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 271/532] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.155091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.156089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f73800-6588-4348-bf2a-cc376bdac480 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.190685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.191503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.191878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.192215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.193042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.193344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.194710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.206302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 262/533] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.207413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.278382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f65b-c05b-45df-aec8-c0afaf05aac3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.311310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89991da-43f5-4a58-a934-3f3e4067e36a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.322285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.323194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.323479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.323754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.324590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.325015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.327267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.342745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 272/534] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.343661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.346114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.347163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.347631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.348088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.355190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.357039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:42.371386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:42.372282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.373455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:42.375656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 263/535] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:42.377106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.460764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22c846-1f91-482c-afc6-24ee04f5d465 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.483980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ccee-6aaa-4333-a358-657dea186751 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.500335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.501787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.502074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.502348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.511742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.513899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.518187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.519057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.519524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.519982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.521058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=ec2c313f5a654d159c98a2f88b8f4d55) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.521556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.523159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.529201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 264/536] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/role_assignments?user.id=ec2c313f5a654d159c98a2f88b8f4d55&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:42.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:42.530796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:42.531637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 273/537] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:42.532800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.538381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.715165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccaac0-57d3-46a7-9344-5cbad0c74b34 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.744809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364f70a-5c08-49d1-96a6-8e4c7b4ff6da None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.751731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.752771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.753280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.753746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.754732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.755271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.756942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.770730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 274/538] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.781598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.781762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:42.782334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:42.782614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:42.782889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:42.783680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:42.783989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:42.785609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:42.804173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 265/539] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:42.810902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:42.955697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50adc38-0966-4450-966a-f5c9ca024e2f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:42.976122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b2a80-d878-4622-a433-1f805f3347f5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:43.002067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:43.002739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.003023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.003302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.004151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=d46868d054b34480935d579ea9b22171) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:43.004482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:43.005952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eab9c6-8ccb-4894-ba01-852024eb0b33 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:43.011978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 266/540] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/role_assignments?user.id=d46868d054b34480935d579ea9b22171&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:43.020339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:43.021343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.021871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.024468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.025592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=3095aa719bfd4f6e803ade0e33e09697) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:43.026102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:43.027904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a748aa-d7e5-4b89-a82c-f7420a993483 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:43.039779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 275/541] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:42 2022] GET /identity/v3/role_assignments?user.id=3095aa719bfd4f6e803ade0e33e09697&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:43.348081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301177e9-782d-4383-a118-4d585d2a0eaa None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.348381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301177e9-782d-4383-a118-4d585d2a0eaa None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.348722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301177e9-782d-4383-a118-4d585d2a0eaa None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.350445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 267/542] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:43.356275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.356610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.356893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.377084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:43.378284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:43.410371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee852a-fb4e-40e5-a0e6-4423021fc9c5 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.410987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee852a-fb4e-40e5-a0e6-4423021fc9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.411462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee852a-fb4e-40e5-a0e6-4423021fc9c5 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.413283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 268/543] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:43.418814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.419099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.419377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.455323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 276/544] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:43.460419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:43.461643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:43.478272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:43.604098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 269/545] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:43.623653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469922-e1ab-4efa-beb3-ba5f3f4bf0db None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:43.643637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:43.663228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:43.664050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.664322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.664628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.685063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:43.692933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:43.693823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:43.694630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 277/546] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:43.700831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:43.799064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c479-2f15-45d9-8427-0fb5d713bd96 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:43.858392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:43.860002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.860515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.860973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.868522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c77d8-674c-44ca-a9c8-1c617558843a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:43.886377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:43.896066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:43.897072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:43.897866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:43.904692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 270/547] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:43.906586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:43.965014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:43.966177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:43.966645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:43.967099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:43.968036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:43.969317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:43.971277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:43.987957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 278/548] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:43.994189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.047050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89b48-614a-470c-85f5-fe22ed418c2e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.110124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.110729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.111013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.111291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.112046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:44.112353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.113786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.131741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 271/549] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:44.138722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.142753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dbde9-3a0c-45de-a52a-ee478bb21d3b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.181119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.182955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.183428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.183886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.196261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.198077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:44.216597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:44.217457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:44.218337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:44.218337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:44.218337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:44.218337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:44.221055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 279/550] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:44.227680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.315082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ece5-aa04-47e3-a09d-24c56a0bfa82 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.347902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.349070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.349539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.350017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.360983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.362687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:44.381571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:44.382450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:44.383288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:44.383288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:44.383288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:44.383288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:44.385760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 272/551] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:44.391643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.398545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2044-69b3-458a-8bb7-66129fdba8c4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.488719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.489806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.491173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.491669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.495703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:44.496323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.498030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.519569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ffd46-eec1-467e-8ba4-b531718bb3fe None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.525931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 280/552] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:44.531506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.594029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.597388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.597888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.598377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.599313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:44.609108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.610385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.628313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 273/553] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:44.637872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.683844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489eae0-95ad-4aa5-94e7-9f13fc16271f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.716865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.718009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.718477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.718952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.726520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.728211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:44.743025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:44.743923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:44.744853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:44.747467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 281/554] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:44.753229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.856764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f460d-f8c3-481a-b9e7-3c6a1fb4efdd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.872184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae61c68-aa9e-4435-90e0-937a8e752931 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:44.907916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.908764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.909049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.909323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.910517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:44.911195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:44.911472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:44.911742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:44.912617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:44.912926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.914376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.923499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:44.924984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:44.939634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:44.940666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:44.941612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 274/555] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:44.948220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:44.969994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 282/556] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:44.975422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.095709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427d09-fc75-4735-90f3-c8a4fb324db6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.129010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.129694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.129977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.130255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.131182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:45.131493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.132973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c19e21-c3cc-4922-ab5b-b2469a672f8a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.165118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372833-b000-4068-96f0-0d10ebbc1ac4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.172378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 275/557] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:45.173815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a035b-43e2-47d3-a8d4-8d6f267a3a0c None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.174110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a035b-43e2-47d3-a8d4-8d6f267a3a0c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.174385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a035b-43e2-47d3-a8d4-8d6f267a3a0c None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.180449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 276/558] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:45.181219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a035b-43e2-47d3-a8d4-8d6f267a3a0c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.212596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.213508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.213792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.214068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.290326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.291804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.295965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a035b-43e2-47d3-a8d4-8d6f267a3a0c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.341736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.342958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.343447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.343737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.357395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.359551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-bdde10fb-1ab8-4a3b-97a2-2ab22e8b4da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:45.385497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:45.386435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:45.387441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:45.387441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:45.387441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:45.387441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:45.387942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 277/559] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:45.389234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.389558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.389831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.398146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 283/560] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:45.399174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.416959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:45.418404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:45.509535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 278/561] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:45.510510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.538858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f6600-b314-4a97-83cb-1bf105ed3870 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.575631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.576477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.576835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.577177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.577981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:45.578349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.579804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.592387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 284/562] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:45.597646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.643800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285e4b-e984-406f-80d9-afa59aabe37b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.681293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.682030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.682307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.682578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.692405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.693888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.705848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e5c7-190f-452d-8565-e3e56eae4153 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:45.710760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:45.712224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 279/563] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:45.713307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.743307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.744107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.744489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.745844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.755051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1f6f1c13-542d-48ed-8da4-12b5d8997195 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:45.762653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:45.763778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:45.764837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 285/564] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:45.765824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4e78-2634-4219-8284-4ad45a006762 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.765824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4e78-2634-4219-8284-4ad45a006762 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.765956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4e78-2634-4219-8284-4ad45a006762 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.767140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 286/565] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:45.768231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589913b-9ff3-4e91-9da7-643dfa229c47 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.768575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589913b-9ff3-4e91-9da7-643dfa229c47 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.769106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589913b-9ff3-4e91-9da7-643dfa229c47 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.772689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 287/566] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:45.773404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589913b-9ff3-4e91-9da7-643dfa229c47 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.818586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d594-956b-4fe4-9864-a6520cacc556 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.853076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.854148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.854428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.854703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.861666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.863117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.873112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589913b-9ff3-4e91-9da7-643dfa229c47 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:45.877414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:45.878800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 280/567] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:45.879682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:45.908465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:45.909350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.909813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.910294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.911600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:45.912199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:45.913517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b795d-e879-4442-9432-a256baf20a33 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:45.925438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 288/568] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:45.926835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b56cd-50d0-429e-ac70-a49169b27434 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:45.927118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b56cd-50d0-429e-ac70-a49169b27434 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:45.927387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b56cd-50d0-429e-ac70-a49169b27434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:45.943623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-682b56cd-50d0-429e-ac70-a49169b27434 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:45.944772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-682b56cd-50d0-429e-ac70-a49169b27434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:45.983836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc0801-159c-4d81-a57c-ce3c0f661860 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.011587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 289/569] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:46.012943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.013247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.013593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.016872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.017529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.017794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.018065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.018844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.019144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.020634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.033259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 281/570] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.033259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.036866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:46.038090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:46.101225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 290/571] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:46.102075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.134409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2e73-14a7-4b56-810b-f3055e65ead2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.166487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.167154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.167432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.167694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.168606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.168910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.170351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.181166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 282/572] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.181934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.195400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb4c8-a386-470d-b098-64eea7e45ab3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.229317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.230110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.230440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.230806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.237835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.239308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:46.253180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:46.254716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 291/573] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:46.255819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.286939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b19c7-127f-4b26-b7c7-dd04df09474a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.319396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.320188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.320467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.320770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.330397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:46.337935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:46.339075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:46.340010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 283/574] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:46.340919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.352947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157abe9-54e3-44c2-b667-ddaae593c783 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.385160 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.385944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.386221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.386492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.396767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.398260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:46.414876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:46.415802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:46.416750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:46.416750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:46.416750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:46.416750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:46.416750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 292/575] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:46.417027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.444082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d96f-6862-4531-ac49-b37da025c4d2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.477262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.477996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.478278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.478550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.488264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:46.495894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:46.497101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 284/576] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:46.498121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.515029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feef3d-6713-43b5-9698-af52f0330729 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.547501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.548386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.548695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.549003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.563496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=e8ed0368b15743bb8a8cec086c575d4b, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.564989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.578795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 293/577] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:46 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:46.579573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.596602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770ce0-3917-4562-b453-ecc3f1bef353 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.641536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.642247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.642526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.642790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.643604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.643914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.645463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.662198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 285/578] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.662876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.691252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0320e-eb1b-455b-bea1-ea2f8ff1e0d3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.725195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.725893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.726168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.726433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.727200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.727560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.728948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.737793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 294/579] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.738733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.765360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec16f-f3f6-4147-9489-6ba21212aba1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.799748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.800417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.800795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.801070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.801805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.802109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.803481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.814617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 286/580] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.815252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.836672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4818f-b485-4460-a942-f139ecda02fb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.869120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.869796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.870080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.870356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.871107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.871446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.872865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.881226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 295/581] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.882487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.910967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70afe2-d3f5-470d-829c-63eb7ca36c2c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:46.943059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:46.943720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:46.944008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:46.944289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:46.945243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=839acae1c8eb4ff29260410a01f2ced6) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:46.945546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:46.947104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:46.960478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 287/582] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/role_assignments?user.id=839acae1c8eb4ff29260410a01f2ced6&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:46.960478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:46.995177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc038b4-9ba8-4443-a3e8-16ed55f45b3d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.037512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.038594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.039023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.039468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.051695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.053517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.071397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461388a8-0e8d-4178-b234-e61faba95cb2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:47.072333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.073490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.074683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:47.074683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:47.074683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.074683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:47.081529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 296/583] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.082735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.109791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.110632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.110923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.111201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.120653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.122270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:47.138025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.139107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 288/584] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.140968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.204785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26dde-7fca-4f6b-a955-22b9c74ec1c2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.238599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.239458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.239741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.240064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.251750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.253397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.259219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6897e-4ea6-48cc-a987-9425cff7a436 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:47.271383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.273666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 297/585] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.275763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.297668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.298340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.298767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.299042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.300209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:47.300673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.302646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.317044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 289/586] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:47.317908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.377869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b86f2-f77a-42bc-8819-119ef734a187 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.418381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.419053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.419335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.420017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.421167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:47.421474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.423389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.431820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e51e-463c-4427-b0ab-46f3a5abcc41 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.448536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 298/587] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:47.449579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.478270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.479250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.479775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.480051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.481083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:47.481390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.483378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.498625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 290/588] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:47.499617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.573068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3181a-c415-4ad4-9bed-4709e93a3a2d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.612778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.613825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.614174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.614520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.615805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e521dd-a495-49a1-bdb0-21c463b537ea None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.623262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.624899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:47.643211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.644216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:47.645215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:47.648908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 299/589] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.649815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.665755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.666804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.667274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.667725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.679387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.681295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:47.700038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.701027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.701970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:47.701970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:47.701970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:47.701970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:47.703669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 291/590] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.704757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.754486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048088bb-7b96-4bc8-aab6-7959134598aa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.788855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.789647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.790062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.790429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.798176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.799890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.807757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bea52-124c-4e24-aa87-4f73ffa8acc1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:47.815381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:47.816409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:47.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:47.822533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 300/591] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:47.823566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.845360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.846275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.846728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.847145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.848139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:47.848628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.850212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.868361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 292/592] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:47.869898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:47.927446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0165b9-adb6-4597-9de6-9851c57c762c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.961552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:47.962377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:47.963645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:47.963645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:47.964058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:47.964476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:47.966328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:47.969615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe48e-287c-4d2a-bd0a-015d4edd2aab None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:47.978417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 301/593] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:47.979340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.011042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.011987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.012627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.013350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.014625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:48.015101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.017444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.040829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 293/594] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:48.042021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.089366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b4b99-0387-4ad2-9e00-430aed09e685 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.123488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.124473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.124760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.125038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.139578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.141676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.144048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcb097-a1d2-4a41-bf1a-a5d35fc913cf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:48.163064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:48.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:48.165591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:48.165591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:48.165591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:48.165591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:48.165591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 302/595] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:48.169337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.184115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.185296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.185817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.186294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.193421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.195197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:48.209349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:48.210266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.211189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:48.213453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 294/596] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:48.214547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.282385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44233f-46e0-4a7c-9dea-a97a83b047e3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.321930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61968ad7-060b-4311-9957-6603a909f5ef None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.323042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.323849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.324131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.324652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.338183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.339899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.359149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.359820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.360104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.360383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.361160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:48.361380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:48.362236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:48.363156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:48.363156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:48.363156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:48.363156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:48.363389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.363389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.370022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 303/597] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:48.371162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.379833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 295/598] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:48.379833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.473635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f21d-22eb-496e-a579-888e14dfb332 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.497392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c0c7-abcf-4e46-ab35-43d1f0b07ee7 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.508003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.508905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.509347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.509762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.510693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:48.511158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.512835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.525591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 304/599] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:48.526777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.533685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.534641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.535113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.535592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.536956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:48.537445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.539664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.558445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 296/600] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:48.558445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.647195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7828b0-346b-4249-b226-db2624c93c1b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.684780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.685603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.685930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.686153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.688411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d29-42be-4565-81d2-7732bc838e72 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.694048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.695556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:48.710562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:48.711545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.712510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:48.716426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 305/601] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:48.717596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.728249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.729569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.730053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.730765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/ec2c313f5a654d159c98a2f88b8f4d55/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.746679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=ec2c313f5a654d159c98a2f88b8f4d55, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.748487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.766548 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 297/602] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:48 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/ec2c313f5a654d159c98a2f88b8f4d55/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:48.768339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.825835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781cf25-0e92-415f-afa9-91cc71be0639 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.862900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.863757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.864045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.864321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.872299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.873934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.879389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80235-8de8-4ab1-8ed2-b9f22cdc70f9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:48.889589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:48.890629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:48.893099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 306/603] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:48.900568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:48.955128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:48.956478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.957093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.957425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.958241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:48.958912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:48.961002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d180b1-d8d7-4b8f-a450-5df4e30ba35b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:48.977560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 298/604] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:48.979536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98409fd-83b2-48a6-9183-6dd365f1bffc None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:48.979882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98409fd-83b2-48a6-9183-6dd365f1bffc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:48.980164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98409fd-83b2-48a6-9183-6dd365f1bffc None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:48.986138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 299/605] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:48.987133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98409fd-83b2-48a6-9183-6dd365f1bffc None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.043644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3c4b-b925-48d4-a8b6-5fb4186c23c0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.081469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.082479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.082946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.083399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.084376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:49.084847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.086451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9327c-84be-4d53-808e-4b27928f8ccd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.098963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 307/606] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:49.105050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c7e0-b77e-4087-a8ad-9a461ab8c9da None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.105593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c7e0-b77e-4087-a8ad-9a461ab8c9da None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.106017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c7e0-b77e-4087-a8ad-9a461ab8c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.108224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98409fd-83b2-48a6-9183-6dd365f1bffc None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.123510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7d78c7e0-b77e-4087-a8ad-9a461ab8c9da None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:49.124974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7d78c7e0-b77e-4087-a8ad-9a461ab8c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:49.148762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.149932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.150216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.150490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/d46868d054b34480935d579ea9b22171/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.168691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=d46868d054b34480935d579ea9b22171, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.170405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.196462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 300/607] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:48 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/d46868d054b34480935d579ea9b22171/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:49.196462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.201173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 308/608] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:49.219198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74ce8-26db-42f6-9c5b-0c9647741971 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.219752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74ce8-26db-42f6-9c5b-0c9647741971 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.220246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74ce8-26db-42f6-9c5b-0c9647741971 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.222119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 309/609] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:49.227519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.228035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.228483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.247788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:49.249527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:49.325412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 310/610] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:49.326678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.338633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bcbb2-d7c8-42a3-813c-1411aa580fba None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.382299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.383216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.383501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.383798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/3095aa719bfd4f6e803ade0e33e09697/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.403681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=3095aa719bfd4f6e803ade0e33e09697, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.405764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.425875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 301/611] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:49 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/3095aa719bfd4f6e803ade0e33e09697/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:49.427051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.461275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29258ce-43e5-40cb-a78e-8398849cab32 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.516681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.517907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.518392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.518866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.533873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:49.544878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:49.545915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:49.546770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:49.550589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 311/612] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:49.556232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.563237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f6a2c-f8c3-4ebe-a15f-08203881eca7 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.600473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.601472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.601847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.602253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.613595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:49.622077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:49.623234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:49.624219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:49.627180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 302/613] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:49.633529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.684228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c37b41-498d-4b91-a304-bbde34f594b6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.728136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.729123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.729734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.730156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.731648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:49.732385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.734921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.745317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 312/614] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:49.751981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.769696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cb5-a67e-4e55-8894-13e7f41e5033 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.806491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.807178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.807467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.807745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.808576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:49.808887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.810316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.823190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 303/615] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:49.824555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:49.875966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd33091-5fb7-4a45-b905-7d95bf3f65f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.921128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:49.922221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:49.922660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:49.923084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:49.944556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:49.946895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:49.961645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a2fe2-d6ee-45a2-bad6-5c4e90bdbcaa None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:49.979193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:49.980417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:49.981640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:49.981640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:49.981640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:49.981640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:49.989207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 313/616] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:49.994536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.004430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.005802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.006253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.006685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.019109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.020821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:50.041669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:50.042910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:50.043952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:50.043952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:50.043952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:50.043952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:50.046430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 304/617] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:50.052373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.160398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8630-faf3-4970-a7e0-00d89ceb8451 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.197269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.198331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.198821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.199339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.200272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:50.200804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.202697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.216003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 305/618] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:50.228617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d4c77-0b99-4e96-9286-c8c06ecb0e6f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.238248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.318475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.319145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.319420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.319689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.320413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:50.320735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.322101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.350988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 314/619] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:50.352728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8991a-5e95-47e6-a94a-920ae22d5a7f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.356334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.390455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.391800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.392294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.392800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.400767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.402493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:50.418567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:50.419533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:50.420533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:50.428846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 306/620] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:50.430611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.535641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916624d7-62b8-4597-b999-c4a616f84c9a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.574160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.575360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.576281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.576808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.577863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:50.578420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.580059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.600194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 307/621] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:50.606027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.606820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87fa3-c6a1-433e-813e-c87cca972220 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.713242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadecda-5b33-4835-8654-4196e00ed72c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.721186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.721953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.722234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.722508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.737554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.739035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.750133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.751568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.752081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.752758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.763554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.765304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:50.772662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:50.773615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:50.774579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 315/622] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:50.779773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:50.787842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:50.788864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:50.789770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:50.789770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:50.789770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:50.789770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:50.793012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 308/623] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:50.798635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:50.899386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9855394-1f81-4c86-86f3-210e22337444 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:50.933113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:50.934248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:50.934743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:50.935224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:50.936161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:50.936711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:50.938326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:50.951140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 309/624] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:50.956796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.056996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a5748-f216-4739-8b63-e0a1c09c3cb5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.062158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88e02-896c-4a5d-8232-9640d1cb42ab None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.091747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.092947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.093453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.093967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.102645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.104345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:51.128188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:51.129219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:51.130209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:51.133964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.134884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.135382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.135873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.137015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:51.137544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.139199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.142149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 310/625] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:51.157444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.174651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 316/626] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:23:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:51.180421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.262768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d1d0-7f50-443d-b6a0-6d69b233a6f5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.296661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.297729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.298238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.298725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.299753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:51.300275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.301956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.315839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 311/627] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:51.334224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.355834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124b99-8607-41e9-903c-021f91ef5817 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.389702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.391061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.391061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.391061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.457167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.458791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db585870-64d5-4c9b-9d36-484aa531323d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.511248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da4725-d54e-41e7-8ec1-61ba77ff9714 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.545615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.546883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.547385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.547860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/839acae1c8eb4ff29260410a01f2ced6/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.561952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 317/628] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:51.563426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49b496-11fb-49e5-a919-d1a73401df43 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.563713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49b496-11fb-49e5-a919-d1a73401df43 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.563987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49b496-11fb-49e5-a919-d1a73401df43 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.564418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=839acae1c8eb4ff29260410a01f2ced6, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.569717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 318/629] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:51.569717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49b496-11fb-49e5-a919-d1a73401df43 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.569936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb886eb-271a-4c04-8f0c-be46f96e9ef3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.592651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 312/630] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:23:51 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/839acae1c8eb4ff29260410a01f2ced6/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:23:51.594228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.594519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.594893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.616952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:51.617949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:51.708768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 313/631] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:51.733602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49b496-11fb-49e5-a919-d1a73401df43 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.764813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.805379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.808656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.809003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.809292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.834981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:51.836476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:51.870288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:51.871357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:51.872257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:51.872257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:51.872257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:51.872257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:51.876513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 319/632] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:51.882198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:51.909271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a8a3a-df43-47b7-b0cc-ae49ac76b21b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:51.948974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:51.950555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.950995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.951669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.964353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f07fb246-aeb8-4663-b25f-2d0da209a00a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:51.974688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:51.975902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:51.977014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:51.984055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 314/633] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:51.984055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da5ae-1250-47f4-ae8a-924d052e1c5b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:51.984055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da5ae-1250-47f4-ae8a-924d052e1c5b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:51.984055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da5ae-1250-47f4-ae8a-924d052e1c5b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:51.984055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 315/634] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:51.990349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da5ae-1250-47f4-ae8a-924d052e1c5b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.012480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd36c3-dfcf-4e6c-869f-2a0320cfa2ff None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.050283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.050947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.051221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.051486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.052201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.052528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.053907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff49a2-4903-4fc3-9568-ec39e1fe298a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.065299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 320/635] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:52.068478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.068478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.068478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.084974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:52.086198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:52.102285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da5ae-1250-47f4-ae8a-924d052e1c5b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.135342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.136019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.136295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.136749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.137493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.137798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.139160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a7cb-6235-49cc-9252-73feb127f68f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.147407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 316/636] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:52.148407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27f84-cb5e-47ca-a497-01060cee7e28 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.148748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27f84-cb5e-47ca-a497-01060cee7e28 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.149023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27f84-cb5e-47ca-a497-01060cee7e28 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.152608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 317/637] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:52.152608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f27f84-cb5e-47ca-a497-01060cee7e28 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.156026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 321/638] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:52.164550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.256523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90038f-3b19-458d-b76e-dd16d654c8bd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.258756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f27f84-cb5e-47ca-a497-01060cee7e28 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.289373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.290173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.290449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.290717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.291206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.292196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.292725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.293195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.299752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.300402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.301476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.301854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:52.315362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:52.316318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:52.317261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0ffb4482-d367-4813-a3b2-4bb20c32801e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:52.318513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:52.319370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:52.325706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:52.325706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:52.325706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:52.325706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:52.325706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 322/639] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:52.325997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 318/640] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:52.326367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.326367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.326367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.326783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.338812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:52.340077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:52.412462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 323/641] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:52.412462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.432831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69980f60-7780-4a20-a8b6-23aa40b4d8d0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.467059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.467872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.468151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.468422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.478731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:52.486791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:52.487788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 319/642] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:52.489321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573acb4-0e8b-43ef-8dd2-cbac57577ee2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.533025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.533697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.533974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.534249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.534968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.535272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.536686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.551873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 324/643] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:52.551873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.591426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347e68-8ed4-4c0e-9ad2-6486b71cf169 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.622490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.623143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.623419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.623688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.624482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.624793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.626599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.643294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 320/644] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:52.643294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.660833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea658b-ec0e-407a-aa82-9da97555ffe5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.692307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.693211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.693566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.693901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.703815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:52.711319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:52.712281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 325/645] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:52.718325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.735480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b72de-6f1f-4850-843e-13127b2f57a3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.767688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.768408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.768653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.768929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.769674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.769973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.771565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.779243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:52.780013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.815113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92faca-2516-4d4f-b919-d1dc2b637690 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.849037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.849759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.850043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.850319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.858673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.859872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:52.873633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:52.874603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:52.875944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 326/647] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:52.876609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.885041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcdbd4-97ca-4f5e-aecc-85d968543d56 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:52.919939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:52.920627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:52.920908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:52.921178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:52.922005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:52.922311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:52.923753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:52.929903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:52.930722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:52.978556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e19bc8-5075-44cf-94de-07eaaa8fefe5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.014522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.015604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.016116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.016640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.017614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:53.018122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.019753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.029417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:53.030732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.040484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1adef-6f4f-4ae1-a156-335668873323 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.069365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.070340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.071452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.071734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.088590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.090778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:53.116627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:53.118454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:53.119571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.146961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f3c3-7452-4156-b1ba-1772f4cd1aa6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.186577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.187400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.187677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.187953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.188820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:53.189128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.190563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.213856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 328/651] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:53.213856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.227826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c41a2-431c-4862-b6e9-bfca04b00f5d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.267901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.268739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.269017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.269290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.279802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.281918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:53.300879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:53.301843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:53.302775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.328632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9916a6-c6df-4238-aaf6-3ca853b3e51f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.363218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.363882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.364163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.364505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.365271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:53.365574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.367000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.379090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 329/653] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:53.379848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.413765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fb35a-dd27-4610-9e45-3ad2b7b7dd28 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.447132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.448147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.448651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.449265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.477357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d0e7-6416-4582-b9dc-64d62e9b26e4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.510718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.511540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.511822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.512092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.512843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:53.513203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.514664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.520598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.522326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.531357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 330/654] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:53.532265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.622532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 325/655] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:53.623721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.636649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5030bf-1ef6-4c7d-a98c-50a51a12e770 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.672678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.673487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.673761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.674028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.681837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.683141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:53.697692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:53.698671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:53.699694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 331/656] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:53.700308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.740069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93deb198-5711-498c-b6df-42f5745c118a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.776720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559460-49dd-437b-b593-d99372840916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.778034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559460-49dd-437b-b593-d99372840916 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.778540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559460-49dd-437b-b593-d99372840916 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.779015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559460-49dd-437b-b593-d99372840916 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.787384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559460-49dd-437b-b593-d99372840916 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.789252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559460-49dd-437b-b593-d99372840916 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.800384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d967-2f33-4303-84e7-65e05179cf7d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-11559460-49dd-437b-b593-d99372840916 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:53.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:53.806893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:23:53.807861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:53.810585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 326/657] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:53.811574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559460-49dd-437b-b593-d99372840916 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.838680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.839407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.839751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.840022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.850266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.851785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:53.869592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:53.870744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:53.871649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:53.871649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:53.871649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:53.871649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:53.871649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 332/658] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:53.871947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:53.922399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559460-49dd-437b-b593-d99372840916 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.956044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:53.956915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:53.957291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:53.957682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:53.958617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:53.959063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:53.960554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:53.969026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859b274-232e-4b19-98f6-85dad9c5a498 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:53.977459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 327/659] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:53.978264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.010137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.010811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.011095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.011402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.012239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:54.012579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.014010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21546-c855-4d75-babf-551b1193b688 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.030316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 333/660] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:54.031547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b578-73c0-4ec2-9af1-93870731e24b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.031832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b578-73c0-4ec2-9af1-93870731e24b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.032108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b578-73c0-4ec2-9af1-93870731e24b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.033499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 334/661] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:54.034130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15b578-73c0-4ec2-9af1-93870731e24b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.078941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073586-4a7e-4e60-9f30-8f96219c4eb5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.110221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.110887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.111168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.111444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.112192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:54.112490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.113906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.124488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 328/662] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:54.125623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.135654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15b578-73c0-4ec2-9af1-93870731e24b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.168830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.169476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.169754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.170023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.222058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703970a-5202-450d-908d-edef00df21b8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.237076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.238625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c85b82-9824-45f7-9756-b16fe59d96dd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.257099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.257766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.258046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.258326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.321344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.322814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.336945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 335/663] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:54.336945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.336945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.336945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.350426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:54.351602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:54.413398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 336/664] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:54.414237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.430962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 329/665] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:54.432217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.525063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862dae9-e803-4b22-8a38-2091fe64cea1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.533849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b1ef4-9303-43b8-8fdd-7c00a546532b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.558573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.559398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.559658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.559934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.566638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.567193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.567988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.568088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.568268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.568569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.578086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.579507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:54.581344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:54.582202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:54.583113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 337/666] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:54.584122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:54.602129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:54.603051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:54.603947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:54.603947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:54.603947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:54.603947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:54.603947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 330/667] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:54.604253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.689712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20ba4-5083-4f0b-aa48-cdb7145f95b4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.702298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a267-02c5-4255-86b5-8a13c64e9f4c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.721836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.722952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.723443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.723710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.733759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:54.733953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.734605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.734886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.735159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:54.741539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:54.742639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 338/668] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:54.743516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.751446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.752957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:54.770036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:54.770966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 331/669] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:54.776689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.839183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996080f7-ee5b-41ad-a5ac-99d66236f96a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.867691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b59e8-6439-4fd9-a5d9-7cede29dfaf2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:54.871751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.872412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.872710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.872980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.873762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:54.874070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.876148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.888210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 339/670] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:54.889082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.902067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:54.902737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:54.903022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:54.903586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:54.904019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:54.904325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:54.905735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:54.921608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 332/671] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:54.921608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:54.981641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f57a4-c72d-4857-8d4c-195d84c91feb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.015814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.016503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.016790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.017066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.017778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b23d1c-3ed0-4e01-9a5c-80edd20ed7ed None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.017886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.018104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.019479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.031701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 340/672] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.031701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.051927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.052627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.052916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.053194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.053922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.054226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.055602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.071067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 333/673] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.071067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.127435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae6ab-6f05-4b76-97e2-c482c83222cd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.162344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0a74d-657f-400f-a384-afe2e9c00629 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.162916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.163187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.163438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.163713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.164587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=ec2c313f5a654d159c98a2f88b8f4d55) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.164908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.166406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.180500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 341/674] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/role_assignments?user.id=ec2c313f5a654d159c98a2f88b8f4d55&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.180500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.220362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.221335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.221682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.222020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.231995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.233927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:55.253460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:55.254595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:55.255515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:55.257287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 334/675] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:55.257287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.306961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ded67-cb82-4f37-84ae-f232c024b1c2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.342023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.342851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.343127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.343399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.354602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.356128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.372827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3590-a2b1-4173-a791-4851360c82f9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:55.376339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:55.377348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:55.378255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:55.378255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:55.378255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:55.378255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:55.378255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 342/676] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:55.378535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.409950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.410755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.411041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.411315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.418792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.420253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6688ef75-2961-47c4-9a9c-092f0841f14a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:55.435700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:55.436681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:55.437590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 335/677] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:55.438141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230ed1-045b-4b21-84bf-0da71f026ba6 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.438141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230ed1-045b-4b21-84bf-0da71f026ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.438344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230ed1-045b-4b21-84bf-0da71f026ba6 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.440472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 336/678] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:55.440673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230ed1-045b-4b21-84bf-0da71f026ba6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.500698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd68c-da7e-4833-9991-1560fb197b71 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.532482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.533248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.533536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.533809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.534593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.534900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.536345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.544205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230ed1-045b-4b21-84bf-0da71f026ba6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.553090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 343/679] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.553090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.579183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.579774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.580057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.580336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.581085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.581389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.582978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bacdf-6c99-4500-88ed-2a3d9532eb74 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.599097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 337/680] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.599097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.599097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.599097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.613314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:55.614504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:55.650478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b655d2-c26d-4d07-8df3-cd41853e7241 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.683603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.684261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.684571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.684852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.685634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.685940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.687388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.699834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 338/681] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:55.699834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.700080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 344/682] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.700080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.795463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2a97-4165-4641-b6bb-98d4ef568142 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.797309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb5304-d0a7-47af-81eb-f94537927930 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.827928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.828613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.828896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.828995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.829177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.829835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.830011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=d46868d054b34480935d579ea9b22171) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.830116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.830331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.830423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.831815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.848687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.848928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 339/683] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/role_assignments?user.id=d46868d054b34480935d579ea9b22171&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:55.848928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.849073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:55.864687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:55.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 345/684] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:55.867111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:55.955231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29de67-7641-4fef-b82b-dd9e7dd59fe5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.976798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d2ab-01c5-40f7-a188-18baae816b46 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:55.990393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:55.991073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:55.991354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:55.991627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:55.992528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=3095aa719bfd4f6e803ade0e33e09697) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:55.992841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:55.994517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.008912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 340/685] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/role_assignments?user.id=3095aa719bfd4f6e803ade0e33e09697&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:56.009954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.015007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.015908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.016259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.016647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.029893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:23:56.038568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:56.040661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:56.042799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 346/686] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:56.050650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.167120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49445e36-0745-4aee-bfe3-903b246dbe37 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.206106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.206818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.207100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.207374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.208163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:56.208496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.209954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.220351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 347/687] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:56.226224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.262823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc999-ac85-4c90-b078-6d8b8d978ea6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.297420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.298099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.298369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.298638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.299485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:56.299788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.301278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.319077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 341/688] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:56.325576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.328931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1405-53fd-4866-9a9e-9888c729f9db None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.363277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.364097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.364378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.364684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.376030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.377560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:56.395434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:56.397727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:56.399954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:56.399954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:56.399954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:56.399954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:56.399954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 348/689] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:56.404509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.427883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12e29-ce40-4666-bbac-245367ef1560 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.461702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.462416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.462705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.462982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.507725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7f65-3248-47f8-a7bf-5ad8c203c964 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.542577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.543942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.544370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.544810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.545755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:56.546221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.547744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.562196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 349/690] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:56.568400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.577300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.578784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.686433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2866-d8f8-461b-955b-832a8fb20328 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.723446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.724708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.725257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.725672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.734024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.735895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:23:56.753188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:56.754426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:23:56.755631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:56.758417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 350/691] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:56.764720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.825158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 342/692] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:23:56.830662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:56.872217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbdf9-6daa-43a7-bb87-596909bc3302 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:56.910949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:56.912279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:56.913053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:56.913494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:56.914488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:56.915236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:56.917027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:56.937343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 351/693] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:56.943406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.044099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a6ac3-1b93-4bac-b3d4-39787bf33d07 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.052912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658705-2c72-49d1-a285-0ddad4c2e37e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.090427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.091483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.091945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.092363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.122062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.122941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.123142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.123411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.146463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.147878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.165944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.167680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:57.184276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:57.185392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:57.186499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:57.186499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:57.186499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:57.186499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:57.186499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 343/694] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:57.191870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.274888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 352/695] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:23:57.281408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.397648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac5ea-9a65-4a9f-bbf4-53acbd6f9dcb None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.401563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d92a4-30b6-48e1-8814-2e68f74bc3c7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.439576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.440787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.441269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.441760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.464311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.468297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.472051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.472984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.474443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.475686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.477729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:57.481318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.482942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.508722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 344/696] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:57.514151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.636425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dafc2-2eb1-4e07-9311-71d572a996fa None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f9cbb26f-d0d3-477e-a6ee-cb61499b447e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:57.644851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:57.646260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:57.647379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:57.647379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:57.647379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:57.647379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:57.649315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 353/697] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:57.650933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58035251-9f39-4b72-92ce-15eb50e83ac6 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.651514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58035251-9f39-4b72-92ce-15eb50e83ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.651973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58035251-9f39-4b72-92ce-15eb50e83ac6 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.654146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 354/698] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:57.655282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58035251-9f39-4b72-92ce-15eb50e83ac6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.678201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.679009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.679281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.679549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.686934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.688861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dae89b4a-78b0-4533-8745-400693130994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:57.703691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:57.704821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:57.705950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:57.710010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 345/699] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:57.710991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.711280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.711539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.727883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:57.729047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:57.763243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58035251-9f39-4b72-92ce-15eb50e83ac6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.803761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.804796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.805242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.805654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.806228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 346/700] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:23:57.806760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:57.807123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.807408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.809044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.830733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 355/701] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:57.831601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:57.928550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa072-3e0c-4c38-b85e-c767f11ccb4c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.935495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c256-cf89-472a-adcd-5cd05ace5566 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:57.970461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.971271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.971552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.971654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:57.971911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.972239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:57.972699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:57.972975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:57.973761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:57.974065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.975645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.983192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:57.985310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:57.987086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 347/702] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:57.987879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:23:58.004281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:58.005270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:58.006200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:23:58.006200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:23:58.006200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:23:58.006200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:23:58.010293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 356/703] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:58.011271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.111788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6bbf-c6c8-453c-a332-67c7cc5c9cb8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.112160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff71e-677c-4086-8cf2-d963c68e3931 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.150282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.150628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.151084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.151293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.151389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.151637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.151742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.151819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.152849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=839acae1c8eb4ff29260410a01f2ced6) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:58.153155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.155052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.158948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.160713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.161714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 357/704] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/role_assignments?user.id=839acae1c8eb4ff29260410a01f2ced6&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:58.162522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:23:58.190370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:58.192664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:23:58.194910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:58.205551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 348/705] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:58.206606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.355219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badddf8-70fd-4712-82c1-b1adc2b8298e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.413496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.414169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.414472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.414744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.415478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:58.415772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.417225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.424671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b99f-2cbe-46c6-ae3e-b743a4884a6d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.429354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 358/706] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:58.435188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.464715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.465762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.466298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.466922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.467939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:58.468496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.470153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.482887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 349/707] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:58.489044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.534919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef882e-5b99-42ff-9d94-1187b8f98fae None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.569326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.570015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.570283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.570557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.571277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.572749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56623503-61f2-4d62-99f3-ae5ad2433150 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.593901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556817-48e5-4e5b-87c6-c1b00be77a4f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.598549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 359/708] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:23:58 2022] POST /identity/v3/users => generated 254 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:23:58.599877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562374d-1e0e-4d36-a9c0-78b75f1dafc2 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.600164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562374d-1e0e-4d36-a9c0-78b75f1dafc2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.605040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562374d-1e0e-4d36-a9c0-78b75f1dafc2 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.607340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 360/709] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:58.613909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.614199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.614457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.645784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:58.647339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:58.648993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.649897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.650009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.650216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.651061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:58.652428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.654679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.661432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 350/710] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:58.732232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 361/711] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:58.755532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.897469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7316-02d5-4592-ad1e-33eadd71abf3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:58.933882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:58.935029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.935491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.935940 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.937031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:58.938702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b23801f9-c5e6-447b-a6a9-7e4242fb9b0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:58.953466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:58.954503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:23:58.955366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:58.957865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 351/712] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:23:58.963680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:58.990031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775acb2-23b7-42e9-b8a6-9a9772dc2b38 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:58.990612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775acb2-23b7-42e9-b8a6-9a9772dc2b38 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:58.991071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775acb2-23b7-42e9-b8a6-9a9772dc2b38 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:58.992896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 352/713] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:59.003504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.003789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.004133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.021295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:59.021966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:59.097925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5f34-cd58-4034-9cfa-a122dee69249 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:59.116621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 353/714] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:23:59.140285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:59.140653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:59.141372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.141661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.141949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.142679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:59.142987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:59.144381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:59.149354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 362/715] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:23:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:59.154972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:59.290689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec5fe-68bf-479d-a2d9-d5d6011a2c60 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:59.311106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177e5d8-89a4-4e17-a1f9-7c5d2335d9c2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:59.348344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:59.349179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.349458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.349731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] PATH_INFO: `/v3/services/network` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.350391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:59.351810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:23:59.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:23:59.366157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:23:59.367045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 354/716] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:23:59 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:23:59.373836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:59.382563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:59.383242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.383519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.383841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.384597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:59.384907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:59.386370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:59.393614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 363/717] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:23:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:59.527882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bee4-3c1c-4554-93a5-a225e205626f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:59.563090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:59.563773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.564055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.564332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.565081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] RBAC: Adding query filter params (name=network) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:59.565379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:59.566786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db387-25eb-444d-997b-0a20916bd378 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:59.572187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 355/718] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:23:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:23:59.578049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:59.715846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e6589-bfdd-4615-ac77-6f96d9cfd9d1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:59.759016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:59.759687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:59.759962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:59.760230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:59.760976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] RBAC: Adding query filter params (type=network) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:23:59.761275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:59.762641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764f52-6400-4313-b6d7-8c0c9fb33673 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:59.767657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 364/719] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:23:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:01.068372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d6f7c-cf57-4c5e-ac15-976c63f6756e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.068924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d6f7c-cf57-4c5e-ac15-976c63f6756e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.068924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d6f7c-cf57-4c5e-ac15-976c63f6756e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.070469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 356/720] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:01.076028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.076457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.076651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.093352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:01.094532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:01.162790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 365/721] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:24:01.186271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d6f7c-cf57-4c5e-ac15-976c63f6756e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.285974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d6f7c-cf57-4c5e-ac15-976c63f6756e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:01.321351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:01.322094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.322376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.322652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.332775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-153dab3d-68a2-4989-853c-7ea7880c6026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:01.340474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:01.341437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:01.342388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 357/722] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:01.347758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.379941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef795f-996c-4387-8a28-907ab35b0f8a None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.380282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef795f-996c-4387-8a28-907ab35b0f8a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.380513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef795f-996c-4387-8a28-907ab35b0f8a None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.382130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 358/723] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:01.387723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093c31-d8ba-498f-a874-ee6b17a80b77 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.388054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093c31-d8ba-498f-a874-ee6b17a80b77 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.388275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093c31-d8ba-498f-a874-ee6b17a80b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.417692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-42093c31-d8ba-498f-a874-ee6b17a80b77 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:01.418909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-42093c31-d8ba-498f-a874-ee6b17a80b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:01.483518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09f96-bc3d-400a-a5a5-d63635afad12 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:01.519570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:01.520257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.520549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.520820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.521576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:01.521880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:01.523666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:01.532883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 366/724] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:01.538696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.606257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 359/725] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:24:01.632169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99898f-949b-4af3-b7f1-c5d55b548b73 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.632531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99898f-949b-4af3-b7f1-c5d55b548b73 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.632794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99898f-949b-4af3-b7f1-c5d55b548b73 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.636099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 360/726] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:01.640477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.640778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.641055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.659682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:01.660915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:01.661507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7dc0-6570-459d-a5fe-e508f779579a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:01.702619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:01.703709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.703991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.704265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.716254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:01.717740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:01.731510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 361/727] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:24:01.732375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:01.740273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:01.741254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:01.742170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:01.742170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:01.742170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:01.742170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:01.744560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 367/728] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:01.747975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.845710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec95c5-d564-4bc4-bb9e-37274858932e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:01.870506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a12c8-c6e8-459f-8c5d-c157ff4e16fc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:01.879072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:01.879955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.880294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.880601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.890741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:01.898437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:01.900693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 362/729] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:01.902126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:01.909912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:01.910590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:01.910872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:01.911143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:01.911871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:01.912174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:01.914046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:01.936682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 368/730] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:01.937885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.028001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973f5-c51f-4308-8b6e-178d6b879300 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.055812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48decf5-8e2a-47d8-8e4d-b27c0e323b7b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.061126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.061983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.062265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.062537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.074160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:02.082550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:02.083649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:02.084578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:02.088709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 363/731] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:02.089797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.106207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.108159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.108789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.109268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.110701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:02.111224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.112866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.125533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 369/732] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:02.127467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.189860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951515-498f-40f5-97d3-7c0e88732eab None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.227970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.229451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.230112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.230877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.241348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.243678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.244682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be2f-f78a-4fd2-b23a-2d5f0b8cc0f7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:02.263794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:02.264954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:02.265906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:02.266499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 364/733] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:02.268464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.288055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.288781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.289063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.289341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.290097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:02.290405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.291841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39077-ace0-41e0-be4e-7e05ee0894e2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 370/734] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac241-1676-498d-89a0-8ec8a85c0c2f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac241-1676-498d-89a0-8ec8a85c0c2f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac241-1676-498d-89a0-8ec8a85c0c2f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 371/735] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:02.304696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac241-1676-498d-89a0-8ec8a85c0c2f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.373687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0843b28-701c-4852-aada-469e8a623d1e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.406664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.407462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.407743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.408015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.410114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac241-1676-498d-89a0-8ec8a85c0c2f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.418367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.419812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:02.436770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:02.437856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 365/736] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:02.438882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.446576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.447246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.447532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.447812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.448766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:02.449076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.450521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226720a-8b4a-4782-acfe-b5f4eeff4e42 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.467559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 372/737] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:02.468772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.469058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.469331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.486099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:02.487278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:02.532251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358508-43b3-4e48-acf7-8dafce121f10 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.562157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 373/738] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:24:02.562157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.565999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.566796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.567073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.567340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.577868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.579331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-26e3ab30-c3c6-4395-a2d0-fa6ef694d7e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:02.595751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:02.596857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:02.597969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:02.597969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:02.597969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:02.597969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:02.600582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 366/739] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:02.601992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050402-b90f-4439-9593-b1f31d9bab5b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.602283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050402-b90f-4439-9593-b1f31d9bab5b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.602566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050402-b90f-4439-9593-b1f31d9bab5b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.603859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 367/740] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:02.604626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050402-b90f-4439-9593-b1f31d9bab5b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.652336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ee7f-a402-4a1c-b98c-bfee78f500fd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.686294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.686974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.687253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.687530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.688249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:02.688587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.689977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.700939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 374/741] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:02.701695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.704382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050402-b90f-4439-9593-b1f31d9bab5b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.736152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.736823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.737105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.737377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.795410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc891-f434-4d53-b166-ddc3a3fd61aa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.799888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.801371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b29d7-b085-4f7c-adf2-bc9a6a6b325d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.827249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.827902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.828181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.828467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.829186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:02.830538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:02.844826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 375/742] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:02 2022] POST /identity/v3/services => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:02.845619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:02.901714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 368/743] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:24:02.903443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.903730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.904043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.922299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:02.923445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:02.962301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def87e5-de8e-43b7-b9d1-d4276d70c812 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:02.997587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:02.998264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:02.998543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:02.998886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:02.999985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:03.000291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.001721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.004782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 369/744] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:24:03.007932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.014700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 376/745] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:03.015639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.107745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d228024-9548-44c8-9d4b-ea0bc7c21fa7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.115656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dde33-39d8-4830-9e1f-44fb5a52255e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.139749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.140793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.140904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.141113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.147725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.148251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.148533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.148811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.149082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.149985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.159426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.160898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:03.164168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:03.165190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 370/746] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:03.166813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:03.178301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:03.179220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:03.180138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:03.180138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:03.180138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:03.180138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:03.180138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 377/747] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:03.184973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.261500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8adf4b-7678-413b-91ce-6a4f2be56e19 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.277821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9cab-71b8-4fba-9ef9-0ce99286e813 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.294453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.295328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.295614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.295935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.303458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.305039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.309038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.309693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.309970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.310239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.310945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.312298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:03.319832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:03.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 371/748] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:03.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.333521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 378/749] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:03 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:03.334754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.444306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ad54-9d10-4f0c-a790-5d5d3540a27b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.455208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c280e-1bfd-4a95-8c67-474608b89de0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.482395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.483365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.483826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.484247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.485361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:03.485891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.487585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.493119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.493819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.494097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.494368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.495182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:03.495485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.496963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.514388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 372/750] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:03.514693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 379/751] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:03.515670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.516175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.624740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca911ed-7220-43ff-8d4e-9bd7f65e68f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.631499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306300ca-96f7-453e-94a2-306e9b8e2f79 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.665309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.666088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.666353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.666755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.669396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.670305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.670800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.671266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.672325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:03.672865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.675449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.676971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.678474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.696578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 380/752] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:03.697745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:03.701172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:03.702077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:03.703021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:03.703021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:03.703021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:03.703021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:03.703021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 373/753] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:03.707956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.802831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f805-5523-4b06-9d02-7d9895445965 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.806850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033065b-0ef2-49e9-bd81-3472f9d2d5f0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.836787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.838066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.838642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.839139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.840097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:03.840917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:03.841289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:03.841656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:03.842469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:03.842923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.844332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.847334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:03.848984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:03.860524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 374/754] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:03.861508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:03.863378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:03.864388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:03.865362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:03.867581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 381/755] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:03.868557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:03.969382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a88967-b059-4b1e-901c-c1cd7f93f23d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:03.975788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3fc4-df16-494f-8508-b62128a5050c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.014801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.015604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.015994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.016345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.017930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.018961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.019669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.020121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.032761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.035124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:04.053650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:04.054578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:04.055506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 382/756] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:04.056001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.092593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.093986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.181554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949eee8-91bc-4bce-84df-e390ba01b9de None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.195023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 375/757] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:04.195973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.223274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.224533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.225165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.225954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.227207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:04.227720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.230434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.245785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 383/758] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:04.247466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.297618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9945-7141-4dcb-8103-c7ee28a6143d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.339304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.340289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.341270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.341758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.343081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:04.343724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.345932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.352404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac3774-86ba-489b-8803-46d7681087a2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.362204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 376/759] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:04.363555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.403982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.405268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.405777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.406250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.419322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.421831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:04.444504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:04.445452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:04.446414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:04.446414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:04.446414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:04.446414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:04.448676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 384/760] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:04.449576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.472290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202c48-b408-434e-87e0-38ff7601f391 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.506751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.507361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.507732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.508098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.509110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=839acae1c8eb4ff29260410a01f2ced6) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:04.509519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.511158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.517508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 377/761] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/role_assignments?user.id=839acae1c8eb4ff29260410a01f2ced6&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:04.518505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.572392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340411c7-98b0-4994-8f59-91eca2411ba9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.607719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.608869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.609271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.609641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.611836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=e8ed0368b15743bb8a8cec086c575d4b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.613449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.631916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 385/762] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:04 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:24:04.680908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516b54-f346-4cc6-8855-7a174ca0dfcb None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.747958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.748681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.748965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.749241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.750385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:04.750692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.752105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.765824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 378/763] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:04.771004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:04.886807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921ed6-a433-4ada-8aec-21319a788850 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:04.921398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:04.922217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:04.922503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:04.922777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:04.929865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:04.931328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:04.945586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:04.946524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:04.947508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 386/764] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:04.953010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:05.059848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fc74-6569-410d-af63-8546cde1e823 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:05.094324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:05.095054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.095339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.095668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.096487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:05.096808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:05.098255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd6c8-0c70-4f45-93e6-593db6683702 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:05.110613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 379/765] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:05.116599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:05.206010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6298d3-72d5-48b0-bfd3-4e69c7d5958f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.206696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6298d3-72d5-48b0-bfd3-4e69c7d5958f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.206696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6298d3-72d5-48b0-bfd3-4e69c7d5958f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.208180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 380/766] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:05.213176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.213576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.213860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.222212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824881d2-7c97-4ee4-ac48-bb2d1779b742 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:05.230367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:05.231567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:05.267005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:05.267673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.268012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.268289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.269164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=dd74544a48d14b728df81973ed0c9cc2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:05.269477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:05.270931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:05.278096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 387/767] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:05 2022] GET /identity/v3/role_assignments?user.id=dd74544a48d14b728df81973ed0c9cc2&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:05.341267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 381/768] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:05.376546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:05.489574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db2c-89b5-4479-8664-0ffbcae45575 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:05.526005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:05.526839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.527121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.527395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.528058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:05.529494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:05.544218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:05.546439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:05.548371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 388/769] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 16 20:24:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:05.553526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:05.709150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bb6c-3b77-4b4a-92e9-51bfc4df934a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:05.768870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:05.769551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.769834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.770109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.770829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:05.771132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:05.772550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32f2b-3579-4f63-bef7-92e6a2404abc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:05.780559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 382/770] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:24:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:05.786210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:05.955908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb716c-7108-44de-b00c-5e20785a7643 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:05.993068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98999f-e2f8-4542-a286-6ba8d1c94f27 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:05.993584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98999f-e2f8-4542-a286-6ba8d1c94f27 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:05.994003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98999f-e2f8-4542-a286-6ba8d1c94f27 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:05.995852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 383/771] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:06.002649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.003322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.003605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.003888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.004629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:06.004936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.006331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.012431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.012920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.013367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.019215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 389/772] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:24:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:06.020601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.042348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:06.044545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:06.143126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 384/773] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:06.173348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.182744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85002f-e7a0-491e-9853-9060dd564eee None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.238114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.238750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.239007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.239257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.240122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] RBAC: Adding query filter params (interface=public, service_id=86b4aa4408ed4543a2e8bac23951d9e4, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:06.240396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.241833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.256260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 390/774] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/endpoints?service_id=86b4aa4408ed4543a2e8bac23951d9e4&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:06.265790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.289809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a625f-9025-4a57-9edf-8d4ad723327f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.323719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.324944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.325449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.325918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] PATH_INFO: `/v3/services/network` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.326773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.328338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:06.340207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:06.341247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:06.342131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:06.350237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 385/775] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:06.361484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.452619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46410c-3660-46e8-acf4-6ab75b3a3a9b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.497944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.498949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.499782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.500250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.501165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.502734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.511931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 391/776] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:06.533225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6608-e659-4ad4-a429-28ae754e9677 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.568522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.569799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.570292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.570771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.571757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] RBAC: Adding query filter params (name=network) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:06.572277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.574049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.580330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 386/777] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:06.589584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.731622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad275b3-8e4c-4d20-8dc0-1ee699c4c8d0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.773575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.774603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.775145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.775617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.776623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] RBAC: Adding query filter params (type=network) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:06.777147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.778792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.784426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 392/778] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:06.793608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:06.930979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1ac9-2125-4b06-b890-59e3cad44d0d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:06.964392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:06.965083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:06.965369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:06.965669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:06.966468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] RBAC: Adding query filter params (interface=public, service_id=a51ef60041494a60a220cfeabae9d203, region_id=RegionOne) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:06.966768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:06.968132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3da7-185d-48e6-a7ba-cbf4199ca310 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:06.976526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 387/779] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/endpoints?service_id=a51ef60041494a60a220cfeabae9d203&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:06.981790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:07.094092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ba53-0bc3-418e-b973-b782f366d072 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:07.133087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:07.133758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.134035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.134308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.134988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:07.136576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de97c7-cf42-4b1a-9acc-a01d7b5df2e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:07.142096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 393/780] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:06 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:07.444667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785e94d-6b9d-405a-8c38-470cfce1d3e2 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.445686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785e94d-6b9d-405a-8c38-470cfce1d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.446161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785e94d-6b9d-405a-8c38-470cfce1d3e2 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.448139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 388/781] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:07.458939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.459445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.459525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.479433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:07.480979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:07.542602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb787-7277-44a0-9b9e-fb21e3ed24c8 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.542602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb787-7277-44a0-9b9e-fb21e3ed24c8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.542602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cb787-7277-44a0-9b9e-fb21e3ed24c8 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.543250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 389/782] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:07.548811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.549274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.549852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.568543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:07.570589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:07.579336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 394/783] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:07.609820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:07.648292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 390/784] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:07.691496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:07.790740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078ee8-2560-48b6-8b02-2dc1b7f0d65d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:07.838114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:07.839170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.839591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.840002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.850591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7c6c1f7d-69d1-471f-8149-eee39f56c575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:07.858542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:07.859741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:07.860837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:07.863229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 395/785] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:07.864671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27df6c-72f6-46cf-addb-7df093328c91 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.865049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6fc6f-e719-416e-afe3-db13fba9a01c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:07.865336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27df6c-72f6-46cf-addb-7df093328c91 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.865781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27df6c-72f6-46cf-addb-7df093328c91 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.867520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 396/786] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:07.871419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27df6c-72f6-46cf-addb-7df093328c91 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:07.915781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:07.916771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.917049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.917320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.927272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-71cc43a1-68b7-480f-9fef-6ea2c5273406 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:07.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:07.936184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:07.937077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:07.939756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 391/787] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:07.945259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:07.945733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:07.946178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:07.963667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:07.965454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:07.996514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27df6c-72f6-46cf-addb-7df093328c91 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.030090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 392/788] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:08.031308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.036275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.037217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.037694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.038159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.039132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:08.039642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.041332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.051678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 397/789] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:08.052868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.162433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930d7f-a6d4-4cb1-9f4e-aee9eb33d984 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.164597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27581059-c146-4cec-93ee-953dbce5a221 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.198516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.199575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.200056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.200562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.201796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:08.202387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.204232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.204536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.205297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.205608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.205881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.215700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 393/790] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:08.216892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.217705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:08.227113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.228191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:08.229150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:08.233619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 398/791] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.234508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.318908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f3c4-f2c7-4411-8e89-9394c86bc75c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.346944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5008b6-71c6-4b39-8d21-8602780114a0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.351691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.352764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.353243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.353784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.364557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.366240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.379790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.380623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.380907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.381186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:08.385431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.386311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.387249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:08.387249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:08.387249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.387249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:08.389557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 394/792] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.390596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.396341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.397837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:08.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.415843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 399/793] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.417419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.491483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6786617-f030-416c-9729-462fadd4cd1a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.515135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7badd77-1832-4162-86ac-7a4bf658aa82 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.529151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.530221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.530704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.531174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.532219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:08.532798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.534452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.548164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 395/794] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:08.549591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.551539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.552208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.552514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.552790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.553516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:08.553820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.555387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.567831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 400/795] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:08.573155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.677002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdddf-3f78-4b4b-8b88-4d915540e1ca None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.679433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27859f-4ac6-4ee0-b4f6-7dc44971163a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.709639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.710380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.710662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.710933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.711652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:08.711954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.713393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.714650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.715667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.716151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.716642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.727309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.729149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.729831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 396/796] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:08.730722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:08.747681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.748668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.749963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:08.749963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:08.749963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:08.749963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:08.752232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 401/797] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.753373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.830002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad342539-b3ac-4315-9916-806c219701f5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.852046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38aa37-96a3-4fa8-94bf-88d92b2a868f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:08.862822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.863523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.863799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.864064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.871324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.872793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.887264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:08.887439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.888325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:08.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:08.891268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:08.891755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:08.892237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:08.893255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 397/798] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.894078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.901534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:08.903248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:08.917733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:08.918703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:08.919665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:08.922312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 402/799] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:08.923298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:08.995833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9cf65-1970-461c-a9dd-702747500a89 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.023032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe60c2-2edd-4dec-a7cf-0bf5aec62a29 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.030881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb356-8860-480f-892c-65696a6c990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.031573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb356-8860-480f-892c-65696a6c990c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.031850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb356-8860-480f-892c-65696a6c990c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.032491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb356-8860-480f-892c-65696a6c990c None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.032935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fb356-8860-480f-892c-65696a6c990c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:09.033240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fb356-8860-480f-892c-65696a6c990c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.034670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fb356-8860-480f-892c-65696a6c990c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.047996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 398/800] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:09.048910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb356-8860-480f-892c-65696a6c990c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.060738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.061434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.061715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.061992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.062853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:09.063163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.064642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.082694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 403/801] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:24:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:09.083477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.149740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb356-8860-480f-892c-65696a6c990c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.182154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fe7ba-647f-4f42-b7b8-4e3fc06ee70e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.187308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.187988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.188308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.188638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.189494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:09.189797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.191225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.212097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 399/802] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:09.213195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.221280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.222515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.222802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.223073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.230762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.232227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c09df9d0-d9b8-4be6-aaed-7f582b8880ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:09.247076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:09.248048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:09.249410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 404/803] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:09.250022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa87e3-fcb8-4109-bdf9-5a6a1b82e4a6 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.250618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa87e3-fcb8-4109-bdf9-5a6a1b82e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.250618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa87e3-fcb8-4109-bdf9-5a6a1b82e4a6 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.251922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 405/804] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:09.252646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa87e3-fcb8-4109-bdf9-5a6a1b82e4a6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.320198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710127-78db-42cb-aa17-afabc4549bea None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.354613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.354792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa87e3-fcb8-4109-bdf9-5a6a1b82e4a6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.355390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.355674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.356003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.365949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.367404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:09.384973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:09.386093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 400/805] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:09.387041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.393227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.393879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.394155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.394432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.457926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.459394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.487453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c36e-d971-48de-b961-05f1a3eea6f9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.524012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.524728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.525086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.525253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.526409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:09.526594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.527988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cc913-d37d-474d-8665-8717dcbfcd83 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.549592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 401/806] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:09.549592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.549592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.549592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.563877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:09.565080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:09.570885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 406/807] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:09.570885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.632559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 402/808] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:09.632559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.683033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24410-7926-46d9-80ac-3b1c48ec295f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.714339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.715000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.715285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.715556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.716309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:09.716645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.718028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.729132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 407/809] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:09.729915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.734804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3b375-b821-41b0-8b65-f0ed83770777 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.769861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.770748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.771031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.771306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.782804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.784893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:09.801943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:09.802945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 403/810] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:09.803862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.829366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d469c7-191b-4b91-be40-84ce15e057b9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.863800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.864627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.864909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.865180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.875764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.877266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a2e1ab09-9b04-480e-a648-8eb134b32355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:09.893820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:09.894692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:09.895599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:09.895599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:09.895599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:09.895599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:09.895599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 408/811] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:09.896485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dc21-a3bd-46a6-952e-fecc7f86267b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.896773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dc21-a3bd-46a6-952e-fecc7f86267b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.897051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dc21-a3bd-46a6-952e-fecc7f86267b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.898278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 409/812] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:09.898959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dc21-a3bd-46a6-952e-fecc7f86267b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:09.903876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15398e-4da0-480e-8e1d-6118ce422ab0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:09.938064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:09.938882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:09.939156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:09.939431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:09.940085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:09.941495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:09.953355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:09.954326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:09.955173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 404/813] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:09.956273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.003973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dc21-a3bd-46a6-952e-fecc7f86267b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.035218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.035998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.036273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.036566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.043137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.044601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.047299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5839b-c3dd-4daf-9859-03d69a949cda None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:10.057825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:10.058750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 410/814] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:10.059679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.084804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.085463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.085747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.085992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.086734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.087033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.088379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd16d-ac9e-458c-9c7d-2c4410432e9b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.099585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 405/815] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.100851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.101149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.101423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.116819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:10.118001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:10.160294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4ac0-61ca-42d7-8bd9-d91f9295d2d9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.183201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 406/816] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:10.184013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.193484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.194159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.194802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.195209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.196112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.196423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.198088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.209985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 411/817] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.210777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.277001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546fda-e357-4273-a78d-8be7ba66625c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.307713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0424c1d-58b0-4483-8386-8ac93694c92d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.310087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.310767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.311054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.311323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.312035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.312336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.313749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.318076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 407/818] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.318832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.343991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.344674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.344952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.345219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.345999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.346301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.347821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.359086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 412/819] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.359871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.417034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baea219-418d-4d0d-8706-69df034a446b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.449937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.450727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.451008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.451278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.456114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6c73e-8a19-40cc-a57d-590d1eb30ace None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.458206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.459659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:10.473440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:10.474320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.475262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:10.476732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 408/820] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:10.477526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.488035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.488865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.489148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.489421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] PATH_INFO: `/v3/services/network` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.490076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.491448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:10.503292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:10.504303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:10.505183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 413/821] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/services/network => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:10.505988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.578698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8737-b05b-4b43-aef8-3618d35d914c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.608944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fd8f0-eec2-4d6d-b280-c64e1adb6924 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.613566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.614370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.614648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.614970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.621887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.623304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:10.637785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:10.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:10.639643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 409/822] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:10.640151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.643790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.644485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.644766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.645038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.645744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.646047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.647418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.652305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 414/823] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.653292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.735034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6969f4-ebb0-4610-a160-18d954e358d6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.749905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b22f4-dde6-4d53-916e-d5da773b0118 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.766295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.767178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.767463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.767736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/839acae1c8eb4ff29260410a01f2ced6/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.769695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=839acae1c8eb4ff29260410a01f2ced6, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.771131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.783098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.783481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 410/824] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:10 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/839acae1c8eb4ff29260410a01f2ced6/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:24:10.783784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.784066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.784267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.784374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.785151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.785460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.786910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.801170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 415/825] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.801840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.893098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96fe-c530-47b4-914d-ad48e2a9edd8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.903978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfe363-3575-4a6c-bf77-f8bb55873635 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:10.927673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.928361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.928673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.928952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.929677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] RBAC: Adding query filter params (name=network) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.929987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.931413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.941221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 411/826] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.941221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:10.943650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:10.944345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:10.944704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:10.944979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:10.945794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:10.946095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:10.947737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:10.965301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 416/827] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:10.965301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:11.041274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd56df-01ed-4a83-a622-d99069c6ed04 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:11.067351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6de21-c663-4499-9e37-2fe09afad03a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:11.074058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:11.074716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:11.074992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:11.075406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:11.076178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:11.077571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:11.104597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 412/828] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:11.104597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:11.116850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:11.118371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:11.118940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:11.119341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/dd74544a48d14b728df81973ed0c9cc2/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:11.146619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=dd74544a48d14b728df81973ed0c9cc2, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:11.148122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:11.176874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 417/829] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:10 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/dd74544a48d14b728df81973ed0c9cc2/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:24:11.178191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:11.313186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe303ec-1a78-4c0a-8ec1-81663f58216e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:11.318298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2052f7-f149-4993-8f76-b41d45b5ae20 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:11.356942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:11.357822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:11.358199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:11.360252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:11.360252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:11.360252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:11.365314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:11.385186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 418/830] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:11 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:11.421891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:11.422666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:11.422949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:11.423223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:11.423967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] RBAC: Adding query filter params (type=network) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:11.424269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:11.425823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c35a69-04a2-4243-8e35-1ce3aeb54004 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:11.445611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 413/831] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:11.457654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:11.594560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705b33-d7c7-467c-bf10-940bfa03cd5b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:11.657473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:11.658189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:11.658460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:11.662039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:11.662039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:11.662039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84d67c-59a4-486c-96f1-4bc9fffeaaab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:11.701742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 419/832] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:13.205512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0110-99e9-4237-ac95-f8babcd1092e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.206625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0110-99e9-4237-ac95-f8babcd1092e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.207114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0110-99e9-4237-ac95-f8babcd1092e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.208981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 414/833] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:13.214859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.215696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.216173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.234424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:13.235900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:13.309176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 420/834] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:13.332762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0110-99e9-4237-ac95-f8babcd1092e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:13.435673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0110-99e9-4237-ac95-f8babcd1092e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:13.477343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:13.478612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.479099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.479576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.492567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-0f31aad8-6ca7-48ce-9998-6fd5d9f6b7f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:13.501174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:13.502157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:13.503024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:13.505855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 415/835] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:13.512813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:13.613466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7135-8b1a-4f36-acb9-74c16d805655 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:13.649034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:13.650126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.650609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.651081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.652051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:13.652667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:13.654394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621297-c4bf-45cb-b6d1-7cf0eb2653eb None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.654891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621297-c4bf-45cb-b6d1-7cf0eb2653eb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.655373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621297-c4bf-45cb-b6d1-7cf0eb2653eb None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.657218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 416/836] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:13.658031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e24b6-d03f-44a1-8793-e43dd44d07d8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:13.659283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0faf3-913d-4f65-9bea-3e3c4cd4a2a6 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.659996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0faf3-913d-4f65-9bea-3e3c4cd4a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.660919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0faf3-913d-4f65-9bea-3e3c4cd4a2a6 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.662813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 417/837] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:13.664620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.665403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.665961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.667334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 421/838] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:13.668741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.669099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.669380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.685619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:13.687007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:13.690576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:13.691875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:13.760493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 422/839] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:13.763121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 418/840] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:13.765329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:13.784364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:13.866841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62dd6-9df5-46dc-9d09-3c37e09b092d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:13.882447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094d111-9a14-460f-9105-fdb8bd794ee6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:13.900849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:13.901657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.901949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.902230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.912204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:13.913701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:13.915974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:13.917034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:13.917497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:13.917949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:13.918777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:13.920452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:13.931128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:13.932128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:13.937284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:13.937284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:13.937284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:13.937284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:13.937514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:13.938440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:13.939399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:13.940165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 423/841] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:13.940165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:13.940302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 419/842] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:13.942436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.034115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb83bf-02ea-4f70-bcb4-da8f9cadd4d9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.039639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac93d6-40f3-434c-acbc-b332c8566384 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.065852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.066646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.066907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.067209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.072176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.072873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.073157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.073432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.074151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.074454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.075845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b641e-867a-4479-8e93-1dbe0facc813 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.077971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:14.085684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:14.086812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 424/843] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:14.087797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.091583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 420/844] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.092993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7e05-1135-4952-aa0d-1e9f4e7aefbd None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.093281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7e05-1135-4952-aa0d-1e9f4e7aefbd None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.093560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7e05-1135-4952-aa0d-1e9f4e7aefbd None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.094809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 421/845] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:14.095456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7e05-1135-4952-aa0d-1e9f4e7aefbd None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.187138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0533ab-2755-448d-ae4f-ff93a9a887c6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.194431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7e05-1135-4952-aa0d-1e9f4e7aefbd None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.220035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.220682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.220983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.221254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.221950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.222235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.223592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.227978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 425/846] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.228141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.228803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.229132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.229230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.229395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.239909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.241384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-eac56349-1b3d-4d8f-b65f-d9706146789c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:14.257281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:14.258394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:14.259345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 422/847] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:14.261053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.261341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.261617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.278451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:14.279625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:14.327974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692b1b-91ab-4aa8-a69e-12436d8bc3a0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.344160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 423/848] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:14.345025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.359274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.359913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.360197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.360495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.361245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.361552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.362928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.371057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 426/849] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.371844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.439722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc43287-498f-4eed-b7b1-649b522b9174 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.466905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ca06-46c3-4dd3-876d-cdc40b4b62fc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.472985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.473684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.473967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.474239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.474957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.475263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.476679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.481371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 424/850] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.482199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.500067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.500806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.501065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.501346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.502221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.502529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.504022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.523312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 427/851] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.525240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.587992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130d34e-1a85-4514-8948-3f01a94144fb None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.623174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.624366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.624702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.624994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.625635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.627035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.635910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9d61-5414-4fa9-9492-971a65ca2299 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:14.639846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:14.640926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:14.641861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 425/852] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:14.642825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.682232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.683201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.683309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.683571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.694563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.696022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:14.713306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:14.714248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:14.715153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:14.715153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:14.715153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:14.715153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:14.715153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 428/853] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:14.715472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.755715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744336-f07d-4907-9ee2-a3f251c37347 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.789827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.790481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.790891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.791167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.812556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ef465-b050-49aa-9a24-8779ee959ffb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.846733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.847323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.847604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.847880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.848632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.848933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.850315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.859312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 429/854] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:14.859312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.860724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.862234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:14.950950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee7a5-6d4b-40e3-9d7e-67994edea60a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:14.959077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 426/855] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:14.959913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:14.990655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:14.991427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:14.993339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:14.993339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:14.993339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:14.993339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:14.994396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.010924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 430/856] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:15.010924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.063563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337359-0f78-46a4-9e6e-b2b94932e1e4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.101580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.102000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeca38-2fc1-4c4e-b705-31876427600c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.102184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.102446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.102725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.103515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:15.103820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.105239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.120867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 427/857] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:15.120867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.139705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.140560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.141013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.141291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.156472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.158659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:15.182065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:15.183055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:15.183985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:15.183985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:15.183985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:15.183985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:15.189979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 431/858] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:15.190973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.244315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527dfe-e357-45db-afbf-461f9f5a53ea None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.280503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.281110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.281388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.281663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.290455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.292016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.305119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be328a-bc9e-4ddd-8e55-9289395189c2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:15.307425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:15.308390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:15.309374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 428/859] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:15.316196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.347864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.355081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.355279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.355553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.356299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:15.356636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.358081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.370722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 432/860] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:15.376549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.414822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a649-d75c-4642-9c7f-4a6715dba2cf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.447385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.448056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.448333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.448636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.449472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:15.449778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.451214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.472630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 429/861] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:15.473924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.475727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe16ba-ffd8-4a4a-9145-e3aa70dbdbc1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.510585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.511695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.512179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.512684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.520012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.521954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:15.536548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:15.537573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:15.538478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:15.544544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 433/862] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:15.547234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.579398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d540a-a8e7-45da-925f-3353267a7e9b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.616557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.617286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.617628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.617966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.651477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437947-9b29-4cb4-b941-df28927a7903 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.686671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.687704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.688109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.688423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.688908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.689794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.690085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:15.690570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.692189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.710172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 434/863] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:15.711400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.793079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 430/864] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:24:15.794394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:15.813050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d8a6-3f45-494f-ab85-a23acca60fb7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.847435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.848493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.848994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.849465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.850510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=839acae1c8eb4ff29260410a01f2ced6) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:15.851016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.852684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.864566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 435/865] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/role_assignments?user.id=839acae1c8eb4ff29260410a01f2ced6&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:15.895259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1c33-6c37-4df9-b5c6-5fc765a08da9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:15.932404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:15.933257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:15.933539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:15.933809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:15.945176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:15.946650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:15.965924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:15.966980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:15.967896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:15.967896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:15.967896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:15.967896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:15.972631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 431/866] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:15.975088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:16.083079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7348a-2894-4906-a65c-01d1a291288b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:16.115586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:16.116260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.116572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.116856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.117580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:16.117886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:16.119293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:16.132211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 436/867] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:16.138183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:16.235734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ca502-4bb8-411f-8eda-b75185f09436 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:16.269129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:16.269945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.270220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.270482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.279411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:16.281286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:16.298574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:16.299555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:16.300474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:16.304611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 432/868] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:16.305981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:16.404054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94130b92-213f-4bb8-ba9e-0f441308d3cd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:16.437269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:16.437937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.438212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.438480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.439268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:16.439572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:16.441044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e49f-9e3a-4ef2-87d8-5e81e7eecdec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:16.456560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 437/869] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:16.459186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:16.559447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2702-962a-4128-9594-9bc972b1cbd3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:16.593009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:16.593664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.593943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.594214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.595036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=dd74544a48d14b728df81973ed0c9cc2) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:16.595342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:16.596783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3481-97d7-42d0-8579-3bef19c19e91 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:16.608571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 433/870] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:16 2022] GET /identity/v3/role_assignments?user.id=dd74544a48d14b728df81973ed0c9cc2&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:16.729107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658e87-8a8c-4bc6-99ea-ad253551ca16 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.729448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658e87-8a8c-4bc6-99ea-ad253551ca16 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.729660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658e87-8a8c-4bc6-99ea-ad253551ca16 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.731336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 438/871] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:16.737130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dfbb2-2304-41e5-b44c-f3dac407962d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.737431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dfbb2-2304-41e5-b44c-f3dac407962d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.737678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dfbb2-2304-41e5-b44c-f3dac407962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.755589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-016dfbb2-2304-41e5-b44c-f3dac407962d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:16.756854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-016dfbb2-2304-41e5-b44c-f3dac407962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:16.829596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 434/872] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:16.854951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658e87-8a8c-4bc6-99ea-ad253551ca16 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:16.959064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658e87-8a8c-4bc6-99ea-ad253551ca16 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:16.991538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:16.992260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:16.992572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:16.992846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:16.993689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:16.995082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba0288-2824-4592-be20-23fbd4781e0f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:17.011289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 439/873] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:16 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:17.389352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8977-d105-4f9a-8bd9-7f4897cdd292 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:17.389914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8977-d105-4f9a-8bd9-7f4897cdd292 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:17.389914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8977-d105-4f9a-8bd9-7f4897cdd292 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:17.391540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 435/874] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:17.396784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e37b-2ee4-45b2-887c-63563e26b475 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:17.397183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e37b-2ee4-45b2-887c-63563e26b475 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:17.397360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e37b-2ee4-45b2-887c-63563e26b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:17.414069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eea6e37b-2ee4-45b2-887c-63563e26b475 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:17.415260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eea6e37b-2ee4-45b2-887c-63563e26b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:17.485158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 440/875] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:17.507560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8977-d105-4f9a-8bd9-7f4897cdd292 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:17.614132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8977-d105-4f9a-8bd9-7f4897cdd292 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:17.648722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99575042-1440-4072-9a42-5f758247480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:17.649740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575042-1440-4072-9a42-5f758247480f None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:17.650214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575042-1440-4072-9a42-5f758247480f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:17.650678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575042-1440-4072-9a42-5f758247480f None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:17.651612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99575042-1440-4072-9a42-5f758247480f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:17.653632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99575042-1440-4072-9a42-5f758247480f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:17.673815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 436/876] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:17 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:18.204092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa4808-6d89-41fa-985d-0cd5a4a9e6e3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:18.204382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa4808-6d89-41fa-985d-0cd5a4a9e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:18.205018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa4808-6d89-41fa-985d-0cd5a4a9e6e3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:18.206860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 441/877] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:18.212365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:18.212907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:18.213381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:18.230092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:18.231568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:18.307300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 437/878] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:18.328926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa4808-6d89-41fa-985d-0cd5a4a9e6e3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:18.429607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa4808-6d89-41fa-985d-0cd5a4a9e6e3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:18.463551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:18.464272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:18.464571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:18.464846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:18.465502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:18.466886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:18.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:18.479926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:18.480851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 442/879] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:18.488118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:18.583364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb011-febd-40ea-b876-8588aa1e9814 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:18.615756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:18.616424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:18.616739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:18.617008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:18.617720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:18.618013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:18.619450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd8d-910c-45fa-a9d9-8b396ec736c7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:18.624871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 438/880] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:18.630412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:18.746497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006dfc2-4fdc-4b35-9fc0-4aa59f316bdb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:18.780349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:18.787406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5df64a-5022-4ea5-83ce-fb249be1cbb6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:18.792473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 443/881] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:19.015928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ea1a-3924-4184-a38b-513243aabaaf None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.016237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ea1a-3924-4184-a38b-513243aabaaf None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.016412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ea1a-3924-4184-a38b-513243aabaaf None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.018100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 439/882] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:19.023520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.023817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.024104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.041725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:19.042916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:19.109030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 444/883] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:19.132648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ea1a-3924-4184-a38b-513243aabaaf None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.234856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ea1a-3924-4184-a38b-513243aabaaf None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.267999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.268778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.269057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.269328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.279510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-31c7a1e2-a400-4606-8957-bb157d403cb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:19.287790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:19.289850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:19.291046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 440/884] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:19.295105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.329838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af18cf-5d2d-4141-af81-e8a3841e7c1e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.330164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af18cf-5d2d-4141-af81-e8a3841e7c1e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.330377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af18cf-5d2d-4141-af81-e8a3841e7c1e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.333098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 441/885] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:19.337444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.337722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.337993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.354407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:19.355576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:19.395171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e10764-697c-4bf9-ba45-d012bece1158 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.428649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 442/886] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:19.431960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.432688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.432973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.433248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.434074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:19.434384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.435901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.444370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.445046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 445/887] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:19.450711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.539894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df68de-73ed-4f3a-b014-c84f8b607c23 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.548985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c00-ea24-48e1-9188-fc6ae9544b5f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.575269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.576028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.576297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.576604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.577365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.578736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.582612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.583421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.583707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.583990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:19.590714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:19.593050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:19.594990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:19.596730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.596730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.597106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 443/888] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:19.598082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:19.622839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:19.624245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:19.625191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:19.625191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:19.625191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:19.625191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:19.630839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 446/889] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:19.632198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.731653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01a211-724e-4d0f-b1c3-07a46952f040 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.734905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d30d-e479-43f9-b11c-372554536682 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.768109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.768815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.769091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.769359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.770077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:19.770376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.771742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.778157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.779576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.780063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.780587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.781944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:19.782709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.788595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.788741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 447/890] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:19.789669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.795535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 444/891] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:19.801781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.893779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236655-bda2-4c8e-aa4b-78948532943a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.922158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31c1cd-e380-42f8-a2aa-a8233931ee97 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:19.929471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.930295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.930963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.931242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.940041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.942214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.957402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:19.958087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.958391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-cc6f5926-7753-4c68-b5c0-b7f3f1004085 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:19.958501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:19.959391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:19.960373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:19.961420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.961420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:19.961420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:19.961420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:19.964728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 448/892] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:19.966003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d63907-e007-4701-9d94-28696f439592 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.966290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d63907-e007-4701-9d94-28696f439592 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.966561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d63907-e007-4701-9d94-28696f439592 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.966958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 445/893] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:19.972520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 449/894] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:19.974666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:19.974962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:19.975155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:19.975326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:19.992296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:19.993642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:20.059631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 450/895] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:20.060761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.090607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da9b8-e9ee-40d1-a8c4-bb762b6dab28 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.124635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.125311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.125594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.125863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.126703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.127003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.128462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.145196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 446/896] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:20.146091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.164491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265d7c-6f78-4010-bc86-03db8d4157c9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.198546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.199229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.199512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.199787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.200606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] RBAC: Adding query filter params (interface=public, service_id=c94510591048474683fafcd8c4270fe6, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.200925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.202309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.212106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 451/897] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/endpoints?service_id=c94510591048474683fafcd8c4270fe6&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:20.213057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.237485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529685-e0e7-4467-adb8-1564ea5409b6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.269599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.270414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.270696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.270965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.271611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.273017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:20.284762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:20.285713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:20.286556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 447/898] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:20.287505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.316291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ad10-4c8d-4dc1-83e2-033a69c396ee None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.350510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.351401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.351688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.351959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.390992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae4eb-b078-426c-a27e-33b6a83fcfb6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.416853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.418294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.430984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.431670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.432065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.432377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.433118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.434491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.448713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 448/899] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:24:20.448713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.549692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 452/900] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:20.550709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.561666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0692d-abd6-4746-a5d5-33b3318ea0b4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.608287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.608956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.609511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.609792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.610525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.610998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.613080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.624641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 449/901] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:20.627039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.670579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6ee7-bea5-44cb-b39c-f317d9cfefc0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.714111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.715418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.715699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.716246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.728552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.730451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.749986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cfa8-f8b0-4e14-a368-52ae238ba044 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:20.753060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:20.753959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:20.754882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:20.754882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:20.754882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:20.754882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:20.754882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 453/902] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:20.760383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.789183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.790491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.790782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.791060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.791972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.792593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.794222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.805854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 450/903] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:20.807192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.869491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0175-6a62-4d53-9f22-7423f06170d7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.906634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.907308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.907584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.907862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.908628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.908932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.910369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.919328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc964a80-818e-42eb-bd4e-9402bdbe961d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:20.922287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 454/904] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:20.931224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:20.961169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:20.961841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:20.962233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:20.962506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:20.963756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] RBAC: Adding query filter params (interface=public, service_id=c0180d76283944f68d4d472b5f8882ec, region_id=RegionOne) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:20.964075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:20.965723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:20.976507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 451/905] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/endpoints?service_id=c0180d76283944f68d4d472b5f8882ec&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:20.978909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:21.056860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb19ac-1117-4a08-ac4a-0e802d10248c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:21.091670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a797d-674e-436e-8afb-03a291f6b176 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:21.093449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:21.094709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.095195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.095689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.104487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:21.106028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-46882700-850c-4a59-8a89-857f443d98e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:21.121234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:21.122359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 455/906] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95a64-e328-46e0-83fa-6f4c02395d50 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.128673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95a64-e328-46e0-83fa-6f4c02395d50 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.129423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95a64-e328-46e0-83fa-6f4c02395d50 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.129423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 456/907] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:21.130466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e95a64-e328-46e0-83fa-6f4c02395d50 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:21.137099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:21.137757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.138034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.138303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.139005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:21.140375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d901f3-6e97-43b4-bd47-0231c2d75810 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:21.156749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 452/908] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:20 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:24:21.156749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.156749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.156749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.176609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:21.178141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:21.255995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 453/909] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:21.278582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:21.285261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e95a64-e328-46e0-83fa-6f4c02395d50 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:21.331462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:21.332190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.332470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.332753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.333559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:21.333867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:21.335839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:21.348057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 457/910] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:21.355930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:21.389351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594963e-e833-4dac-bda8-b56da2cee571 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:21.426565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:21.427624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.428103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.428628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.429572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:21.431179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18ff2f-205b-42e5-a66f-0b0c82a0eb96 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:21.450681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 454/911] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:21 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:21.487907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1b588-8c5b-48cd-aa31-ed6ed14b888f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:21.532048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:21.532758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:21.533039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:21.533367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:21.534220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] RBAC: Adding query filter params (role.id=29caa359a426487293ee54343712ef6b, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=dd74544a48d14b728df81973ed0c9cc2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:21.534532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:21.536088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af100f7b-0200-4fbc-898e-fa4bf8db5e43 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:21.543020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 458/912] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:21 2022] GET /identity/v3/role_assignments?user.id=dd74544a48d14b728df81973ed0c9cc2&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=29caa359a426487293ee54343712ef6b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:22.747794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1f12-e8f6-4427-aa49-f604d6ad99d6 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:22.748752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1f12-e8f6-4427-aa49-f604d6ad99d6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:22.748752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1f12-e8f6-4427-aa49-f604d6ad99d6 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:22.750373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 455/913] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:22.755813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:22.756335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:22.756335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:22.773115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:22.774330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:22.840343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 459/914] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:22.862318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b1f12-e8f6-4427-aa49-f604d6ad99d6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:22.959321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b1f12-e8f6-4427-aa49-f604d6ad99d6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:22.991546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:22.992349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:22.992682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:22.992955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:22.993698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:22.995076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:23.007203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:23.008264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:23.009274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 456/915] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:23.014795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.114378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c385bb-bdeb-4aae-93ad-c953895189f6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:23.148203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:23.149344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.149826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.150326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.151254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:23.151761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:23.153390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.159003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 460/916] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:23.164485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.266027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b589-d913-4759-b5db-5b709957e14c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:23.301190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:23.302245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.302755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.303237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.304158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:23.304697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:23.306347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d87f2-9075-4832-bdfa-e0bd8871c1e3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.312018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 457/917] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:23.321574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.419634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472ab74-86c2-4edb-8c71-bdd14091c59b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:23.441525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802542-4d22-4539-995f-1ede73eafc8f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.441858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802542-4d22-4539-995f-1ede73eafc8f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.442090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802542-4d22-4539-995f-1ede73eafc8f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.443965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 458/918] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:23.448683 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3760a5-49c5-4e8c-9384-c19dc827484e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.448971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3760a5-49c5-4e8c-9384-c19dc827484e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.449259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3760a5-49c5-4e8c-9384-c19dc827484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.456110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:23.457102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.457611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.458107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.459037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:23.460630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.467092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1d3760a5-49c5-4e8c-9384-c19dc827484e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:23.468405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1d3760a5-49c5-4e8c-9384-c19dc827484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:23.495582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 461/919] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:23.565524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 459/920] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:23.591712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.717432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a97c6-8d6a-4f2f-9b36-2ccf5cb98ac4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:23.752393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:23.753249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.753530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.753812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.754461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:23.755833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.766992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef6f5-454c-4d61-a5e9-5e888d7a521b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.767500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef6f5-454c-4d61-a5e9-5e888d7a521b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.767587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef6f5-454c-4d61-a5e9-5e888d7a521b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.769075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 460/921] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-df339fc0-1229-46a9-aa91-d7b2f7c090ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:23.769262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:23.770189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:23.771700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 462/922] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:23.776578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef6f5-454c-4d61-a5e9-5e888d7a521b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.778953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409163-0ee0-4d19-ac23-e8d7efcc5fec None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.779241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409163-0ee0-4d19-ac23-e8d7efcc5fec None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.779795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72409163-0ee0-4d19-ac23-e8d7efcc5fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.797846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-72409163-0ee0-4d19-ac23-e8d7efcc5fec None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:23.799403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-72409163-0ee0-4d19-ac23-e8d7efcc5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:23.865737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 463/923] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:23.867500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799250-634b-48ff-829c-128b13ac7ef6 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.868083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799250-634b-48ff-829c-128b13ac7ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.868641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799250-634b-48ff-829c-128b13ac7ef6 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.870161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 464/924] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:23.875870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.876391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.876895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.897583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:23.898102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef6f5-454c-4d61-a5e9-5e888d7a521b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:23.898762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:23.931256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:23.931978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:23.932264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:23.932555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:23.933310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:23.933611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:23.934995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:23.943988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 461/925] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:23.943988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:23.968104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 465/926] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:23.969129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.041734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d01b54-de8c-4ae0-8238-5c88b0e4b325 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.074314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.075103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.075385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.075666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.086167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:24.086930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292a7d-bc18-455c-9623-1b135076169f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:24.094377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:24.095372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.096271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 462/927] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:24.097223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.125705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.126812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.127223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.127500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.128413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.129058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.130770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.137945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 466/928] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.138747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.199962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf6ce-f78c-4d2a-910f-bece056c3b5c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.231943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.232554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3317c9-db48-40be-9fc7-0754e060e6d9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.232781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.233058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.233329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.233977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.235350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:24.247046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:24.248712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.249571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 463/929] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:24.250610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.270036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.271094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.271574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.272076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.273049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.273561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.275060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.288207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 467/930] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.288207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.346188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e153c-3fa8-4b09-8fea-8d9f9ce48f6a None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.379524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.380111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.380394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.380709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.381558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.382936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.384120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8f40c-0911-48cf-a2ff-b9498e0372db None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.401608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 464/931] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:24.410282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.427308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.427786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.428066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.428341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.429122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.429433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.430942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.441352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 468/932] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.443286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.550093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0397d-6c52-4148-9149-ca7ab588d2c3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.552630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc3d9-e3a8-4294-beed-1baea64ae458 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.586236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.587069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.587359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.587636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.588362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.588701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.590096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.591468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.592468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.592896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.593331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.600602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 469/933] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.603578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.606557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.608041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:24.625336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:24.626469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:24.627536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:24.627536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:24.627536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:24.627536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.627801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 465/934] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:24.638788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.714121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0fc50-6296-40ed-92a3-c61547add99d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.749166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.750111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.750560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.750996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.751314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df9b9-c45f-43ae-83ab-5c2055dd78cf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.752113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] RBAC: Adding query filter params (interface=public, service_id=75e6049ecd224488b9e71b1bd408a27b, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.752614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.755146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.762134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 470/935] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/endpoints?service_id=75e6049ecd224488b9e71b1bd408a27b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.767171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.788814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.790318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.790861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.791344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.792316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:24.792866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.794530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.807195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 466/936] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:24.813665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:24.871044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cea7f-07c2-4384-b1fd-91e68447e8bf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.911229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.911908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.912192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.912504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.913198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.914555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ebde5-2d86-4a7a-870c-993df90b0b94 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:24.914666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.928610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 471/937] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:24:24.958165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:24.959445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:24.959976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:24.960465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:24.969191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:24.971086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:24.988422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:24.989487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:24.990463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:24.993686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 467/938] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:24.999863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.110586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a3e0d-4bc0-44e7-835a-e20363f6c3ef None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.145068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.145737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.146012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.146280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.147108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:25.147410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.152211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.170085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 472/939] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:25.175206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.276691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54369-3d0f-4d3c-b3b3-3d1588ccdc01 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.310130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.310939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.311213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.311480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.321967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.323418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:25.341158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:25.342148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:25.343286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:25.343286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:25.343286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:25.343286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:25.343286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 468/940] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:25.348227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.446871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e43a-7184-421b-aed8-55353b97dd66 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.480800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.481860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.482363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.482844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.483775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:25.484287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.485974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.498522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 473/941] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:25.503838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.597946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15368-027a-429f-bb01-0cdde1c4f7b2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.643535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.644383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.644697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.644968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.652554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.654030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-d4593806-e236-40a9-bbb6-006c44631112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:25.667869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:25.668855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:25.669956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 469/942] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:25.674939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.777147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98245-bbed-46c2-a36a-39b44a4fcece None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.811255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.812357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.812663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.812936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.813730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:25.814039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.815503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.818396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8321c-6ff7-41f2-8206-f63d483079cf None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.818396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8321c-6ff7-41f2-8206-f63d483079cf None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.818925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8321c-6ff7-41f2-8206-f63d483079cf None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.820195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 470/943] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:25.825519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.825807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.826079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.830254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 474/944] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:25.837399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.842546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:25.843715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:25.916546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 471/945] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:25.933014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:25.936608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71950-427a-47a6-a63d-a9897127e7aa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:25.969794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:25.971072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:25.971560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:25.972033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/dd74544a48d14b728df81973ed0c9cc2/roles/29caa359a426487293ee54343712ef6b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:25.974859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=dd74544a48d14b728df81973ed0c9cc2, role_id=29caa359a426487293ee54343712ef6b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:25.976527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:25.990844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 475/946] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:25 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/dd74544a48d14b728df81973ed0c9cc2/roles/29caa359a426487293ee54343712ef6b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:24:26.033260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d186619-e296-4738-b8b3-e9155083c520 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:26.070143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:26.070817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:26.071140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:26.071412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:26.072121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:26.073641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:26.075068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING keystone.server.flask.common [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 20:24:26.096127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.sql.core [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:24:26.096127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 20:24:26.096127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [parameters: {'id': '0946f783865241e49b5fe6665fa20678', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 20:24:26.096127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79846) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0946f783865241e49b5fe6665fa20678.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0946f783865241e49b5fe6665fa20678. May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application conn.query(q) May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:24:26.113818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application result.read() May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 20:24:26.114847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application next(self.gen) May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application yield resource May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application next(self.gen) May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise self.value May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application session.commit() May 16 20:24:26.115809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self.session.flush() May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application compat.raise_( May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:24:26.117195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:24:26.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application conn.query(q) May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application result.read() May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:24:26.123494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [parameters: {'id': '0946f783865241e49b5fe6665fa20678', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:26.125342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:26.127749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0946f783865241e49b5fe6665fa20678. May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:26.129218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 472/947] 10.222.0.49 () {60 vars in 1140 bytes} [Mon May 16 20:24:25 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:26.129794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:26.231794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db3c0-bd2f-4949-b8d7-a75e445910e1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:26.265303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:26.266115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:26.266391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:26.266657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:26.273600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:26.275134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2df22b92-13d2-416b-b393-0127994bda44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:26.289345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:26.290503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:26.291610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 476/948] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:26.296756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:26.395622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b903e-aead-4ec3-90db-c34478c6d42d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:26.428583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:26.429245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:26.429526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:26.429801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:26.430674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:26.430981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:26.432644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e72088-41cc-4bc3-a1f2-87ae2ff915ce None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:26.456648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 473/949] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:26.771566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e51e-025d-4875-ace6-39bf5aaba2a4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:26.772013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e51e-025d-4875-ace6-39bf5aaba2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:26.772403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e51e-025d-4875-ace6-39bf5aaba2a4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:26.774225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 477/950] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:26.780116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:26.780637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:26.781083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:26.798790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:26.800563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:26.869730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 474/951] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:26.892641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e51e-025d-4875-ace6-39bf5aaba2a4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:26.992872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e51e-025d-4875-ace6-39bf5aaba2a4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.027382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.028593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.029081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.029553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.030426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.032038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:27.045040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:27.046136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:27.046989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:27.055089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 478/952] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:27.057656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.159484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db327-0193-4dd3-9a76-f9a759da2415 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.196197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.197312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.197796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.198282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.199195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:27.199698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.201459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf89e7-3b7d-402e-82e3-7dced4585ff5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.211684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 475/953] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:27.213352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.233569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d22-af35-48d4-ac66-2c30474618d4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.233768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d22-af35-48d4-ac66-2c30474618d4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.234005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913d22-af35-48d4-ac66-2c30474618d4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.235569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 476/954] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:27.241145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.241290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.241474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.258934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:27.260048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:27.328587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 477/955] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:27.337898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114d12-ff77-4751-8621-bd8530bc8628 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.348908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.378613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.379827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.380289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.380765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.381823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:27.383079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.384734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.396894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 479/956] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:27.457983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f62cf-aa36-4074-86b4-506ac437780b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.495036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.496299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.496819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.497307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.498558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.500173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:27.513503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:27.514574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:27.515471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:27.518603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 478/957] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:27.527389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.633363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431882-7889-4681-9986-b434dbe11f6c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.672319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.673037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.673372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.673644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.674417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:27.674728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.676100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.681314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 480/958] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:27.687308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.783649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bd7f-a4f1-43db-b9a8-53e743aefaab None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.818175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.818848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.819195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.819386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.820097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:27.820397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.821831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdcd5d-242b-459f-a89c-a07402080e86 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.827122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 479/959] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:27.832803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:27.934954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fc8c-6731-4dad-a374-97e427c77765 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:27.972484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:27.972484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:27.972484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:27.972484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:27.972924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:27.975167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465ea15-a53e-44d9-8883-92c754eba9c3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:27.996713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 481/960] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:28.257159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7467b-9c92-4eee-b993-e58a7a0b0a58 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.257690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7467b-9c92-4eee-b993-e58a7a0b0a58 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.257690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7467b-9c92-4eee-b993-e58a7a0b0a58 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.259429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 480/961] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:28.264873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.265163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.265447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.285998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:28.287199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:28.369385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 482/962] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:28.392259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7467b-9c92-4eee-b993-e58a7a0b0a58 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:28.491980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7467b-9c92-4eee-b993-e58a7a0b0a58 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:28.525945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:28.526693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.526973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.527248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.537452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:28.545856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:28.546788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:28.547640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 481/963] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:28.553032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:28.660601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8396-f9f7-4fe4-a39c-9ba1eac96986 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:28.694653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:28.695334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.695676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.695960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.696760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:28.697067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:28.698459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cd36f-ba7d-42cb-ad9b-15c9a48ea848 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:28.707393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 483/964] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:28.712637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:28.784629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03a3f-5eb9-462c-b143-d9b74cb30b19 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.784813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03a3f-5eb9-462c-b143-d9b74cb30b19 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.785275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03a3f-5eb9-462c-b143-d9b74cb30b19 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.786962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 484/965] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:28.792250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.792654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.793004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.814980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:28.817145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:28.818826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a66e-ed51-4943-b8ec-3b98efe8d53d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:28.853266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:28.854226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:28.854601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:28.854972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:28.865141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:28.866731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:28.885751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:28.886919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:28.888046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:28.888046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:28.888046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:28.888046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:28.889373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 482/966] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:28.894382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:28.907478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 485/967] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:28.932816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.008655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b156f1-60de-417d-a926-e2b20a930edb None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.048925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af15af-e2f7-45c5-9d5d-5940d8a2384c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.056097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.057447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.057932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.058755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.060013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:29.060695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.062507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.078461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 483/968] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:29.084223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.087726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.089244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.089518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.089788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.090492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.093874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.095907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING keystone.server.flask.common [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 20:24:29.112695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.sql.core [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:24:29.112695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 20:24:29.112695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [parameters: {'user_id': '98ca5a12e5084b1e843959bd106efff4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 20:24:29.112695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 20:24:29.123938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:24:29.125029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application yield resource May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise self.value May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application session.commit() May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:24:29.126227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.flush() May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application compat.raise_( May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:24:29.127403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:24:29.128560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:24:29.129623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [parameters: {'user_id': '98ca5a12e5084b1e843959bd106efff4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:29.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 20:24:29.131781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 20:24:29.133101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.135870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 486/969] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 16 20:24:28 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:29.141387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.207623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857953f8-620b-4313-a8cb-c2f15195fca3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.251814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.253471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.254232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.254688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.256184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544b6e0-8a07-4149-a334-0dd1cf063aa8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.264317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.266856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:29.287546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:29.288639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:24:29.289718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:29.291850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 484/970] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:29.296482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.296482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.296482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.296482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.297874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.303434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.305521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:29.321466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:29.322453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:24:29.323426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:29.330707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 487/971] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:29.333585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.400400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7be4-6d64-4459-b78f-ae97ab4956d9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.442425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacf06e-987a-466b-bf01-6024109ad65e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.443129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.444162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.444670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.445924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.446980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:29.447470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.449154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.471720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 485/972] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:29.478023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.482806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.483356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.483735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.484105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.485051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:29.485455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.487171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c211126-dd92-4ed5-af7f-d16e13d57b95 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.532477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 488/973] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:29.596327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b3841-5f73-44d9-8a09-40dd5dbfedbf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.633050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.633820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.634111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.634387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.712674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.714784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:29.739329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207aa31-6672-4758-9870-6c7ec8f79cb7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.739659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207aa31-6672-4758-9870-6c7ec8f79cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.739890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207aa31-6672-4758-9870-6c7ec8f79cb7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.741604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 489/974] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:29.747571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.748293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.748516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.766757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:29.768288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:29.836539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 486/975] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:24:29.838478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.847956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 490/976] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:29.869877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:29.944584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385639c2-7f35-495c-9311-efaac097da93 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.974634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb90b5-3622-439f-88f5-aa2bbfbbaba0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:29.978145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:29.979064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:29.979282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:29.979578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:29.989692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:29.991566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:30.009451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:30.010433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:30.011377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:30.011377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:30.011377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:30.011377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:30.011377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 487/977] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:30.015454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.016255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.016529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.016949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.017380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.018237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.019763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.034864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 491/978] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:29 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:24:30.122468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b389c8-00ed-4679-b147-75c3966d130e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.165829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.166856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.167313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.167759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.168694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.169198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.170792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4d90-4714-41aa-8de2-6d7656405efc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.188106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 488/979] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:30.189498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.271293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362671e-35b5-476d-8597-58ee02025e6d None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.271820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362671e-35b5-476d-8597-58ee02025e6d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.271820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362671e-35b5-476d-8597-58ee02025e6d None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.273504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 489/980] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:30.279770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.280091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.280369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.298449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:30.299644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:30.300186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d84c7-4356-479d-bc2a-f25f1d94378a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.333070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.333871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.334152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.334428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.341091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.342550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:30.356077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:30.357193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:30.358097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 492/981] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:30.362937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.370521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 490/982] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:30.393189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.463311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6960-268b-48a3-a5c0-0f44e9832904 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.486968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b5d7-c1c4-48a2-bd74-b6605cd8dc4f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.508032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.509188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.509771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.510497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.511707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.512327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.514532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.520500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.521330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.521573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.521873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.522497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.523906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.532536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 493/983] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:30.534222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:30.536154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:30.537384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:30.538243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:30.540716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 491/984] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:30.543260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.639918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9a35-5758-43b5-b79b-13acf7513dbf None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.640950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3bf9-c3ee-4f70-beab-8c4b0cd0729c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.675808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.676101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.676489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.676608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.676779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.676873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.677031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.677122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.677725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.677964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] RBAC: Adding query filter params (role.id=29caa359a426487293ee54343712ef6b, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=dd74544a48d14b728df81973ed0c9cc2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.678068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.678276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.679366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.679698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.696736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 494/985] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/role_assignments?user.id=dd74544a48d14b728df81973ed0c9cc2&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=29caa359a426487293ee54343712ef6b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:30.696972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 492/986] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:30.697089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.799201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe8614-4f0e-4f94-80bf-e38b5f73baf2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.836294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.836970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.837230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.837535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.838255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.838563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.839977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.850783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 495/987] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:30.852275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:30.953657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945ec8c-d6b4-4c24-8aa2-bf8aaeda5792 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:30.985509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:30.986163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:30.986424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:30.986718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:30.987523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=75e6049ecd224488b9e71b1bd408a27b, region_id=RegionOne) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:30.987833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:30.989214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e252a-363a-44a4-bd7f-0ca454f7c4f9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:30.994467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 493/988] 10.222.0.49 () {56 vars in 1249 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/endpoints?service_id=75e6049ecd224488b9e71b1bd408a27b&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:31.000309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:31.098322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04cceb-43a6-4f64-a951-8ded83defa9a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:31.132975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:31.133672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:31.133927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:31.134232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:31.134921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:31.136301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f9ea7-d0f3-4093-8c41-11f0147fd360 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:31.142879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 496/989] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:30 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:24:32.274407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8689-2c08-4a75-96ef-98144ccea002 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.274986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8689-2c08-4a75-96ef-98144ccea002 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.274986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8689-2c08-4a75-96ef-98144ccea002 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.276533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 494/990] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:32.281712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.282146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.282226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.299285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:32.300486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:32.364672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 497/991] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:32.387423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8689-2c08-4a75-96ef-98144ccea002 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:32.490425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8689-2c08-4a75-96ef-98144ccea002 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:32.524839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:32.525555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.525841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.526116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] PATH_INFO: `/v3/services/compute` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.526770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:32.528141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:32.539679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:32.540742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:32.549989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 495/992] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:32.550901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:32.647139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efac3f-7a73-43c7-929a-52923b940d2d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:32.683376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:32.684047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.684329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.684635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.685363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:32.685675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:32.687050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:32.692043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 498/993] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:32.697686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:32.802486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f035b3a-00fa-4b00-acc5-b649601da0de None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:32.836596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:32.837271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.837555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.837828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.838540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:32.838840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:32.840214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7e61-0aff-4ac2-8b9b-99a1b76bce4e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:32.845247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 496/994] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:32.851127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:32.909977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77013cdb-5e9a-42e5-96d6-bef3c0b9323e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.910314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77013cdb-5e9a-42e5-96d6-bef3c0b9323e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.910536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77013cdb-5e9a-42e5-96d6-bef3c0b9323e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.912036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 497/995] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:32.916754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.917058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.917319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.934943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:32.936128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:32.950365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2ddd-acba-4f1d-ae72-b100c429ad69 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:32.984306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:32.985006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:32.985291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:32.985570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:32.986364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] RBAC: Adding query filter params (interface=public, service_id=3bd8bec47add4127b95aa98e488aeba8, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:32.986676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:32.988061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:32.998068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 499/996] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:32 2022] GET /identity/v3/endpoints?service_id=3bd8bec47add4127b95aa98e488aeba8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:32.999012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.006854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 498/997] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:33.028033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.098282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b27a9-d08c-4abe-b589-a38781eeaf49 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.125385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541bfa-6934-4729-bb90-d2b720bf66c4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.130140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.130802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.131081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.131351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.132023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.133590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.139695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 500/998] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:32 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:24:33.162603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.163417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.163721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.164036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] PATH_INFO: `/v3/services/image` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.164790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.166271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:33.179307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:33.180502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:33.181400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:33.182998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 499/999] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:33.187166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.287844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c0dd-fcdc-44b3-87f1-6785993a92ab None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.325477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.326155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.326433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.326704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.327447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] RBAC: Adding query filter params (name=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:33.327748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.329174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60697-80ed-417f-8c7f-d585673e1d1c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.336877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 501/1000] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:33.340470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.355678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2c8de-915c-4f0f-8d05-7252f02dc5be None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.355898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2c8de-915c-4f0f-8d05-7252f02dc5be None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.356156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2c8de-915c-4f0f-8d05-7252f02dc5be None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.358182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 502/1001] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:33.362626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.362899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.363174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.380182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:33.381399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:33.438565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a021-4eb5-41a6-b202-0e8242d61525 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.446523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 503/1002] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:33.469029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.470488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.471343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.471623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.472639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.473559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] RBAC: Adding query filter params (type=image) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:33.473868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.475253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.488464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 500/1003] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:33.586376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa55614-dae6-47a9-875c-9d02eb32dfea None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.623934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.624710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.624995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.625269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.625936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.627355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:33.640181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:33.641314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:24:33.642183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:33.646656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 504/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:33.649650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.749110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae5a69-750c-4b69-bc6b-189215db63d0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.781417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.782085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.782364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.782634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.783339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:33.783646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.785056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.790028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 501/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:33.795745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:33.892058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43f16-8ba6-4f66-afc5-e3f7e91d749d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:33.923987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:33.924687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:33.924970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:33.925241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:33.925953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:33.926253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:33.927638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b94f-b391-4845-be25-416a6ba1f828 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:33.932617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 505/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 16 20:24:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:33.938302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:34.037219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaec75c-a50b-4262-9681-6aa1fa32c96e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:34.070480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:34.071133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:34.071414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:34.071648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:34.072418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:34.073809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0422c-91a3-4cc0-9000-677fe34fb114 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:34.088790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 502/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:35.374871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeb10-0edd-4a50-a809-bdc886aa16b8 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.375480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeb10-0edd-4a50-a809-bdc886aa16b8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.375480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeb10-0edd-4a50-a809-bdc886aa16b8 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.376996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 506/1008] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:35.382252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.382798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.382890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.399878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:35.401108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:35.472268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 503/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:35.495247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddeb10-0edd-4a50-a809-bdc886aa16b8 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:35.602854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddeb10-0edd-4a50-a809-bdc886aa16b8 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:35.641207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:35.641945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.642229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.642498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.643156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:35.644626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-79e6a725-b69c-467f-ab94-4e7eaac9098b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:35.656528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:35.657641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:35.663580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 507/1010] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:35.667695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:35.687445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341ab17-74ad-469f-9fb4-30932ec4719b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.687748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341ab17-74ad-469f-9fb4-30932ec4719b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.687997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341ab17-74ad-469f-9fb4-30932ec4719b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.689581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 508/1011] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:35.694503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.694873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.695306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.712059 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:35.713283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:35.766298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003fd0-9eb4-472c-8859-4e94589be67b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:35.779514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 509/1012] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:35.799086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:35.799755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.800082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.800311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.801354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:35.803922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:35.804232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:35.805706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:35.815627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 504/1013] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:35.817359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:35.903173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003b34-53e2-45d2-a133-4569519436e2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:35.918678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5e79-f279-458b-aa30-90125dec32fe None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:35.935175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:35.935844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.936135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.936403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.937189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:35.938561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:35.953278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 510/1014] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:35 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:24:35.959586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:35.960274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:35.960639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:35.960944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:35.961662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] RBAC: Adding query filter params (type=compute) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:35.961967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:35.963397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d13f-6907-4aa1-96ef-abe8db6120af None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:35.974023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 505/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 16 20:24:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:35.975986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:36.086689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d7cd-bbf9-4285-af8b-2a6982208e3c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:36.123526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:36.124203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:36.124489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:36.124769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:36.125534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:36.126977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06667-45a6-4619-b63a-1d7a2f13a2ba None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:36.149334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 511/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:36.313849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55e2-d589-4b54-90d1-ef0fc3d8f41f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:36.314044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55e2-d589-4b54-90d1-ef0fc3d8f41f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:36.314271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c55e2-d589-4b54-90d1-ef0fc3d8f41f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:36.315908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 506/1017] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:36.321741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:36.322075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:36.322276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:36.339834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:36.341073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:36.416147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 512/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:36.438907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c55e2-d589-4b54-90d1-ef0fc3d8f41f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:36.536350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c55e2-d589-4b54-90d1-ef0fc3d8f41f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:36.570290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:36.571007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:36.571286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:36.571522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:36.572747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:36.574186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609e710-61fc-412c-ab01-1652dceae44c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:36.576018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 507/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:36.581763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:36.682550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbdcfd-13e7-4a58-aa20-e20a85c7cffd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:36.715447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:36.716119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:36.716408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:36.716712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:36.717436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:36.718877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9680b33-8931-4fd4-976d-c9c65769b85a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:36.751324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 513/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:24:36 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:38.194243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a1e2-de9f-47da-99dd-e23ac4f1acc8 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.194794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a1e2-de9f-47da-99dd-e23ac4f1acc8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.194794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a1e2-de9f-47da-99dd-e23ac4f1acc8 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.196364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 508/1021] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:38.201706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.202114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.202216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.219943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:38.221150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:38.288734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 514/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:38.311400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a1e2-de9f-47da-99dd-e23ac4f1acc8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.413799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a1e2-de9f-47da-99dd-e23ac4f1acc8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.447642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.448359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.448661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.448941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] PATH_INFO: `/v3/services/image` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.449592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:38.450955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-5867aa78-b2aa-4603-b041-a916c3c5fa0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:38.462485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:38.463525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:38.464370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:38.468950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 509/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:38.470118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.471684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903864-e08b-47ff-97f2-e895f3e85c17 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.471974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903864-e08b-47ff-97f2-e895f3e85c17 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.472225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903864-e08b-47ff-97f2-e895f3e85c17 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.473588 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 510/1024] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:38.478600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.478892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.479162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.495329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:38.496566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:38.560420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 511/1025] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:38.567417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377395ae-c4e6-44d8-9e3b-0f5f1f1ff9ba None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.583309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.600714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.601444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.601726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.602005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.602713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] RBAC: Adding query filter params (name=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:38.603020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:38.604395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:38.609478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 515/1026] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:38.615046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.677599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6631426-36ee-4c4c-9843-d51de35e5bef None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.713854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.714601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.714882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.715154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.717716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4de9f-a0c1-4418-acd3-d238b133ff21 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.725484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:38.733554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:38.734506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:38.735380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:38.739879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 512/1027] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:38.740514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.752225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.752919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.753200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.753476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.754171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] RBAC: Adding query filter params (type=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:38.754472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:38.755856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:38.760895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 516/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:38.766651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.842084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f8d9-a57a-451b-8c8a-d0a348c52e02 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.868219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bc0e5-71e6-4c40-ba83-03fdbd73d738 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:38.875003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.875672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.876250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.876250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.877011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:38.877309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:38.878693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:38.886677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 513/1029] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:38.892310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.902291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:38.902956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:38.903235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:38.903506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:38.904295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] RBAC: Adding query filter params (interface=public, service_id=1c191db09d3f4d62a0454539273f8e40, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:38.904635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:38.906005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:38.915467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 517/1030] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/endpoints?service_id=1c191db09d3f4d62a0454539273f8e40&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:38.916301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:38.988165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bcd78-2e92-497d-84b7-743ed4451aef None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.016284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940cee7-cdab-4789-b873-58aad0db0a24 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.020760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.021550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.021828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.022096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.032449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.033896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.048830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.049506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.049789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.050063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-e2fef63c-2f4a-4920-b00a-4d8643e9f778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:39.050409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:39.051462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:39.052558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:39.052558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:39.052558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:39.052558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:39.052821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.052895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 514/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:39.052971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323332b-e118-4579-84d9-e48c4509a2ac None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.053182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f85f-8038-42d2-a253-5f5f3df4d39f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.053464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f85f-8038-42d2-a253-5f5f3df4d39f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.053735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f85f-8038-42d2-a253-5f5f3df4d39f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.055223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 515/1032] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:39.057432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f85f-8038-42d2-a253-5f5f3df4d39f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.068498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 518/1033] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:24:38 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:24:39.068498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.068498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.068498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.078864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:39.080093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:39.149388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 519/1034] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:39.163902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f85f-8038-42d2-a253-5f5f3df4d39f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.173942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.200592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.201296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.201553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.201828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.202576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:39.202880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.204300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.216367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 516/1035] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:39.222499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.277324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c91b-1558-4466-91e6-df7c1cd9b5b8 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.310966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.311769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.312050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.312320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.313539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.314991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.321518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 520/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:39.321662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff905-1ac3-4b91-8505-7a068d313d7f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.322371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.354220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.355134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.355422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.355696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.363484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.364984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:39.379265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:39.380281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:39.381442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 517/1037] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:39.386326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.421424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81a69-4c31-4df3-b7ea-cddebf65c040 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.454509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.455175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.455455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.455726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.456447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.457898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.478559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 521/1038] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:24:39 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:24:39.488959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43771ab-fa7f-47d2-b2a1-a99ffe75544b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.527221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.528027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.528244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.528592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.529495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:39.529871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.531357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.557574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 518/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:39.559419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.664050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3b5cb-a11a-4033-9900-96ee452d854b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:39.697582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:39.698254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:39.698534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:39.698808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:39.775277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:39.776805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:39.873798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 522/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:39.879360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:39.977997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88912e6-b00e-49f5-b53c-769590f1e403 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:40.011103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:40.012218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:40.012721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:40.013194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:40.022893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:40.024551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:40.044134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:40.045130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:40.046416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:40.046416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:40.046416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:40.046416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:40.046416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 519/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:40.051015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:40.147493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d207cd-e99b-4496-8ae7-0fa0ab6955a3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:40.180876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:40.181551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:40.181835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:40.182104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:40.182829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:40.183130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:40.184568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:40.197739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 523/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:40.203232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:40.298891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81ab-d579-4a47-8445-7b1823df8070 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:40.332253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:40.333083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:40.333363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:40.333638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:40.340535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:40.342003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:40.355536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:40.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:40.357466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 520/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:40.366235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:40.463084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe99c-3213-4cd2-824e-ddf7e742e1d6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:40.495528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:40.496174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:40.496458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:40.496743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:40.497892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:40.498194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:40.499612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d691-8258-4e27-b0ed-5bc7ec6cb60f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:40.511398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 524/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:40.517311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:40.619519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd7e98-5fdd-4c1a-b799-a8e93728b919 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:40.664243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:40.665147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:40.665622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:40.666084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:40.667096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] RBAC: Adding query filter params (role.id=29caa359a426487293ee54343712ef6b, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:40.667584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:40.669237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebe718-c41f-4f20-b8dc-3f7fd247d5cc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:40.680479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 521/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:40 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=29caa359a426487293ee54343712ef6b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:41.292377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8139-db57-4ae7-88d3-5469e7971420 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.292839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8139-db57-4ae7-88d3-5469e7971420 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.292942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8139-db57-4ae7-88d3-5469e7971420 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.294315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 525/1046] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:41.299829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.300322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.300403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.317561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:41.318772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:41.386150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 522/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:41.408465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8139-db57-4ae7-88d3-5469e7971420 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:41.508471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8139-db57-4ae7-88d3-5469e7971420 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:41.541382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:41.542175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.542513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.542705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] PATH_INFO: `/v3/services/image` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.543377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:41.544783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:41.556761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:41.557898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:24:41.558749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:41.560856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 526/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 16 20:24:41 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:41.564425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:41.668305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c469d-9563-4fbb-84f9-0883a688ed67 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:41.700396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:41.701087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.701372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.701700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.702459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] RBAC: Adding query filter params (name=image) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:41.702758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:41.704153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0932528-3dbc-4492-8cc2-6a8a0dfa2b78 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:41.713774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 523/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:41.714727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:41.745339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab147-87d5-44df-bb2b-60283c6bd6a6 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.745679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab147-87d5-44df-bb2b-60283c6bd6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.745907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab147-87d5-44df-bb2b-60283c6bd6a6 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.747791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 524/1050] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:41.752707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.753002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.753285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.770992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:41.772555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:41.817092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9efe44-9c2d-4ff3-99fa-1ffa2510866b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:41.837597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 525/1051] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:41.849620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:41.850301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.850591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.850903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.851613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] RBAC: Adding query filter params (type=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:41.851919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:41.853325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:41.863051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 527/1052] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:41.863213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:41.864671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:41.960019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a35f83-afa8-49fe-9cf4-ef4c81ab9f5b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:41.961391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e659e-7d30-4c42-b292-5ebec0db23cb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:41.993930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:41.994755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.994914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:41.995023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.995286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.995387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:41.995702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:41.995973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:41.996742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:41.998473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.005952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:42.014179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:42.015198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:42.016070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:42.028857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 528/1053] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:24:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:24:42.029073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 526/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:42.029193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:42.140651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093b5e-8475-454c-a19e-a6319c9ba399 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:42.176056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:42.176786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.177069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.177342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.178110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:42.178420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:42.179869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.189120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 529/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:42.195079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:42.292729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545fe6-f0b7-403c-9c50-14899219ec19 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:42.325812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:42.326694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.326973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.327253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] PATH_INFO: `/v3/users/791c8a6f5dc54793a12ed89cc5994655` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.340578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=791c8a6f5dc54793a12ed89cc5994655)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:42.342063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.343995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 527/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/users/791c8a6f5dc54793a12ed89cc5994655 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:42.349666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:42.449483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935bf0-01f3-471f-9cfe-5fafec715dad None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:42.484265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:42.484947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.485229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.485501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.549426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:42.550901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.644934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 530/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:42.650801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:42.758722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8460-5faf-469b-b500-cde79ec79bf5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:42.792658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:42.793523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.793805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.794053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.795298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:42.796810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef490911-51f5-4900-9083-d827be91fffb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.798681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 528/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:42.804813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:42.851085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75070f-3508-476f-a059-9ee69adce740 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.851429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75070f-3508-476f-a059-9ee69adce740 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.851639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75070f-3508-476f-a059-9ee69adce740 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.853051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 529/1059] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:42.862232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.862232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.862232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.876241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:42.877466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:42.912846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d34a2-9577-448b-a75c-2a453d3ca0b3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:42.944652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 530/1060] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:42.945157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:42.945813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:42.946083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:42.946348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:42.947182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a, user.id=791c8a6f5dc54793a12ed89cc5994655) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:42.947494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:42.948965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:42.960535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 531/1061] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/role_assignments?user.id=791c8a6f5dc54793a12ed89cc5994655&scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:42.960729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.063714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8af0ab-d873-42ef-a5e5-65ba614b16d6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.101101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.101931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.102217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.102469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.113746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:43.122572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:43.123616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:43.129982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 531/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:43.130719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.230291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf4ab-c4b5-495a-a15a-3fdb587604f9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.263695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.264362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.264663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.264924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.265661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:43.265962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:43.267323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:43.275523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 532/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:43.281100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.377631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537dd8-47ee-4574-bb79-c63307134ef9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.408787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.409623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.409895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.410198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.420255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:43.421738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:43.438032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:43.438945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:43.441524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:43.441524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:43.441524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:43.441524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:43.441524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 532/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:43.445000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.541277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01ad3-556a-4fb6-b360-dbf98364df05 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.573377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.574035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.574313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.574584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.575278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:43.575608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:43.577016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:43.592514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 533/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:43.594796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.699786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33c6c-60ee-46dc-845c-53933a6c9644 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.733514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.734298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.734586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.734853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.742493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:43.743933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:43.758774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:43.759768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:43.761147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:43.766359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 533/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:43.766507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:43.866609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bd16-7086-47f6-8140-6504a61f8131 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:43.901870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:43.902785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:43.903202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:43.903636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:43.904631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:43.905073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:43.906636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:43.926453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 534/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:43.931999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.033418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074a01-9eba-4e07-8fe5-96053cf22b55 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.070097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.070923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.071319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.071583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.084293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.085916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:44.104850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:44.105850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:44.106796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:44.106796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:44.106796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:44.106796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:44.106796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 534/1068] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:44.111920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.209792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f84b90-dd27-4c84-84e9-6a4a92af3a55 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.244352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.245043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.245332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.245607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.246294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:44.246595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.248320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72203ce-f6aa-483b-bef6-f26847a1a1c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.263914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 535/1069] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:44.265140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.265730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158253e8-e2d5-433b-bcde-884810396645 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.266028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158253e8-e2d5-433b-bcde-884810396645 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.266285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158253e8-e2d5-433b-bcde-884810396645 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.267719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 536/1070] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:44.272825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.273136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.273389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.290360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:44.291583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:44.355019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 537/1071] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:44.362632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93aef3-74e6-44b1-93b0-73d2b4db1a77 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.377296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.395286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.396127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.396406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.396706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.403182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.404663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:44.419149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:44.420062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:44.421016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 535/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:44.429550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.473853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fda3d-d569-4338-ab6c-8318c16c22a2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.507523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.508171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.508465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.508752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.526068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc2ee-c28e-4b2c-b49b-9b4d6ec728a0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.559919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.560620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.560906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.561183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.561978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:44.562288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.563743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.573958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.575347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 536/1073] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:44.575522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.581197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.678331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 538/1074] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:24:44.679316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ebe34-d10b-48a3-9509-0b6350903786 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.684151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.712838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.714071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.714526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.714969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/29caa359a426487293ee54343712ef6b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.717707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=e8ed0368b15743bb8a8cec086c575d4b, role_id=29caa359a426487293ee54343712ef6b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.719353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.733855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 537/1075] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:44 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/e8ed0368b15743bb8a8cec086c575d4b/roles/29caa359a426487293ee54343712ef6b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:24:44.794770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d999-da13-4978-9874-b024a2a54e4c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:44.831742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:44.832609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:44.832876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:44.833150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:44.844649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:44.846154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-13ba1c32-9cf1-4ddf-b644-21c958d8a7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:44.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:44.866028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:44.872565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:44.872565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:44.872565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:44.872565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:44.872565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 539/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:44.874763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:44.984924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49373d9b-1217-40f1-a9b1-3ca7d75dc210 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:45.017602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:45.018272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.018555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.018833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.019555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:45.019861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:45.021262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c9589-25ec-460c-a7e3-6a5f1b90e832 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:45.033020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 538/1077] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:45.140957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec748-b28b-4ef6-9f6b-d2ff8460eb57 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.141318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec748-b28b-4ef6-9f6b-d2ff8460eb57 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.141503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec748-b28b-4ef6-9f6b-d2ff8460eb57 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.142982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 540/1078] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:45.149136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.149425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.149688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.167840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:45.169088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:45.239480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 539/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:45.271348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bec748-b28b-4ef6-9f6b-d2ff8460eb57 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:45.377573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bec748-b28b-4ef6-9f6b-d2ff8460eb57 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:45.411417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:45.412215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.412500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.412799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.423533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:45.431465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:45.432486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:45.433398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 541/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:45.438991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:45.540004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc66b7-a2a4-4fb7-9c79-4395a453f301 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:45.574258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:45.574920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.575201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.575478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.576221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:45.576556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:45.577913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:45.586281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 540/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:45.592312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:45.699417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7436-45d4-4424-b9ba-25247abbcfb6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:45.733058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:45.733911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.734193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.734493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] PATH_INFO: `/v3/users/791c8a6f5dc54793a12ed89cc5994655` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.735706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] RBAC: Authorizing `identity:get_user(user_id=791c8a6f5dc54793a12ed89cc5994655)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:45.737193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:45.738855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 542/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:45 2022] GET /identity/v3/users/791c8a6f5dc54793a12ed89cc5994655 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:45.744793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:45.845283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a31-6b24-497e-98b1-73882cd7e669 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:45.879986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:45.880888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:45.881170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:45.881446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:45.882902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:45.884396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca0231-bc8d-411f-b184-70d0ff67d54c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:45.886124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 541/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:24:45 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:45.892221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:45.997892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ad5a-70c4-448b-a82b-c14f6ff07747 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:46.036281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:46.037221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:46.037503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:46.037781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a/users/791c8a6f5dc54793a12ed89cc5994655/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:46.040023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] RBAC: Authorizing `identity:create_grant(project_id=89cf7efaf7c340138e1f3630d7af7b6a, user_id=791c8a6f5dc54793a12ed89cc5994655, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:46.041502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a498a4-d9ad-462b-afc1-95d85556f166 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:46.056116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 543/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:45 2022] PUT /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a/users/791c8a6f5dc54793a12ed89cc5994655/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:24:47.001109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f144-0492-48cc-a9da-022048ee0b4b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.001632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f144-0492-48cc-a9da-022048ee0b4b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.001632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f144-0492-48cc-a9da-022048ee0b4b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.002954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 542/1085] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:47.008484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.008939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.009030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.025712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:47.026877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:47.091896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 544/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:47.114743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f144-0492-48cc-a9da-022048ee0b4b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:47.220241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f144-0492-48cc-a9da-022048ee0b4b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:47.252747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:47.253474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.253723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.254018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.264254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:47.272365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:47.273466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:47.279521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 543/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:47.281921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:47.380844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbf920-f2c3-4b7f-8fff-40c663ae1a70 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:47.414862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:47.415526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.415800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.416069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.416846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:47.417146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:47.418504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:47.426132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 545/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:47.432191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:47.531900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0b98-0ec5-41e2-969e-cdb3f00d179f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:47.565234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:47.566024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.566302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.566577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.577140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:47.578594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:47.595373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:47.596288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:47.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:47.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:47.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:47.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:47.597411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 544/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:47.602579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:47.709743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871d296-cc29-41d0-bd22-a8f5ec11d75d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:47.744257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:47.744954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.745258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.745532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.746259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:47.746922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:47.748317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:47.761053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 546/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:47.766703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:47.866959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec261f-4459-4c7e-81f0-dedeaa8aa2f1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:47.899842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:47.900659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:47.900937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:47.901189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] PATH_INFO: `/v3/users/nova` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:47.908606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:47.910044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:24:47.923661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:47.924664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:47.926052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 545/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:24:47.930853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.032985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce4f7b-a1cb-4ec4-8553-2c945b6b1e08 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.069932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.070620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.070904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.071179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.072037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:48.072348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.073866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88cc38-3d77-41db-9ac7-5a99834e2bcc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.092495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 547/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 16 20:24:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:48.098300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.202221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab1db-531b-4319-a22f-eac439e5b8af None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.235171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.235817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.236092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.236227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71bc78-261e-4cba-b8bb-2d722b9b8dca None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.236320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.236458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71bc78-261e-4cba-b8bb-2d722b9b8dca None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.236758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71bc78-261e-4cba-b8bb-2d722b9b8dca None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.238290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 548/1093] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:24:48.243139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.243419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.243693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.260560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:48.261735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:48.300322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.301827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.324865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 549/1094] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:24:48.347575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.396195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 546/1095] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:48.401880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.441799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8c1ff-abd1-41fe-89ab-68b4eadda510 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.474084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.474892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.475175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.475511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.485464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:24:48.493009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:48.494184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:24:48.495068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:24:48.495748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa974f4-9a92-48a3-9d92-de44c6361cda None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.495835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 550/1096] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:48.500403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.527950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.528838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.529123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.529433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.539308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.540787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:24:48.558076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:48.559047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:48.560074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:24:48.560074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:24:48.560074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:24:48.560074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:48.560074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 547/1097] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:48.564926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.598415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1f754-aa9c-4168-b4b4-06750c7e80d1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.631045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.631734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.632016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.632289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.633056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:48.633358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.634761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.643034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 551/1098] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:48.649068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.663816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680df657-7955-4360-a8bf-6cf6d3fa868d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.696148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.696841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.697124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.697402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.698124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:48.698429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.700569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.711529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 548/1099] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:48.717222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.744067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64351a-0f5a-49e0-a360-b73aba85baa2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.775885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.776781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.777064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.777341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] PATH_INFO: `/v3/users/791c8a6f5dc54793a12ed89cc5994655` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.778553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] RBAC: Authorizing `identity:get_user(user_id=791c8a6f5dc54793a12ed89cc5994655)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.780019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.781700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 552/1100] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/users/791c8a6f5dc54793a12ed89cc5994655 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:48.787376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.809869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39eda-b4f6-415b-9d70-efbbae20343c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.840627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.841415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.841689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.841956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.848170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.849643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:24:48.863191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:24:48.864159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:24:48.865129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 549/1101] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:24:48.870055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:48.882000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4ab0-bf75-41c2-9b53-7137c7e37d82 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.915289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:48.915940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:48.916224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:48.916528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:48.969917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e60068-59f6-4d6d-9fc1-fa806875106e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:48.985818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:48.987287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:49.003782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:49.004409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:49.004716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:49.004966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:49.005748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:49.006063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:49.007560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:49.019125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 550/1102] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:49.025395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:49.083112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 553/1103] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:24:49.089061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:49.124498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5caf-5ac0-49dd-9b51-797aa82b7921 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:49.157697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:49.158342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:49.158622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:49.158894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:49.159722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] RBAC: Adding query filter params (role.id=29caa359a426487293ee54343712ef6b, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=e8ed0368b15743bb8a8cec086c575d4b) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:49.160028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:49.161499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:49.167422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 551/1104] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:49 2022] GET /identity/v3/role_assignments?user.id=e8ed0368b15743bb8a8cec086c575d4b&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=29caa359a426487293ee54343712ef6b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:49.183354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471cfd-4a99-49c9-86cf-4638323aa13d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:49.220339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:49.221231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:49.221509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:49.221780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:49.223094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:49.224611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59380f10-6f9c-4fc6-85a8-76c00d72e4d7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:49.226672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 554/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:24:49 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:24:49.234469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:49.341843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7fdd2-cf8f-4a40-bd61-a5ec20e7873f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:49.376660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:49.377326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:49.377612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:49.377890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:49.378713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a, user.id=791c8a6f5dc54793a12ed89cc5994655) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:49.379035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:49.380497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03013f-8102-4c44-8df2-2c9df952b336 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:49.386388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 552/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:49 2022] GET /identity/v3/role_assignments?user.id=791c8a6f5dc54793a12ed89cc5994655&scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:51.619483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd1a3-a7ff-461e-be52-31590058a6eb None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:51.620051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd1a3-a7ff-461e-be52-31590058a6eb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:51.620051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd1a3-a7ff-461e-be52-31590058a6eb None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:51.621820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 555/1107] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:51.628278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:51.629050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:51.629187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:51.653210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:51.654397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:51.722221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 553/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:51.747331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fd1a3-a7ff-461e-be52-31590058a6eb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:51.859803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fd1a3-a7ff-461e-be52-31590058a6eb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:51.898682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:51.899421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:51.899706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:51.899982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:51.901236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:51.902698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab66d-81bf-424c-b709-bb41b8999269 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:51.904331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 556/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:24:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:51.910635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:52.032473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcd7ca-f025-43c4-b95a-04953a6788df None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:52.071130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:52.071787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:52.072069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:52.072349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:52.073092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:52.074537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723a1a3-82f9-41e2-8946-2ca41b818a48 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:52.097057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 554/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:24:51 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:24:54.319021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda13d5-aa94-4759-bfe2-aaa7e0ba4946 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:54.319649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda13d5-aa94-4759-bfe2-aaa7e0ba4946 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:54.319649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda13d5-aa94-4759-bfe2-aaa7e0ba4946 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:54.321132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 557/1111] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:54.327675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:54.328414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:54.328584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:54.354206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:54.355433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:54.423366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:54.454687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda13d5-aa94-4759-bfe2-aaa7e0ba4946 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:54.558584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda13d5-aa94-4759-bfe2-aaa7e0ba4946 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:54.594315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:54.595108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:54.595399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:54.595672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] PATH_INFO: `/v3/roles/294f84347b07412085947d751f52f815` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:54.597199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] RBAC: Authorizing `identity:get_role(role_id=294f84347b07412085947d751f52f815)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:54.598572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:54.599970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 558/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:54 2022] GET /identity/v3/roles/294f84347b07412085947d751f52f815 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:54.606018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:54.708570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd44dd-e8c4-4a62-82fc-238dd9b93622 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:54.742047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:54.742905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:54.743183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:54.743452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] PATH_INFO: `/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:54.756991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] RBAC: Authorizing `identity:get_user(user_id=01f1266205ed4860ace0ba8c9dc6f7cc)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:54.758452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:54.760116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 556/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:54 2022] GET /identity/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:54.766447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:54.883299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903d45-ec65-4bb4-a528-8fc338e85d61 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:54.915640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:54.916313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:54.916628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:54.916902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:54.985242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:54.988219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:55.090538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:24:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:24:55.099662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:55.211758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739410-3c6b-4ef4-8cd0-b936e47f74d2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:55.249505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:55.250360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:55.250631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:55.250900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:55.252133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:55.253600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32513e9d-70c0-4aea-bc2f-e65d5cb368d6 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:55.255292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 557/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:24:55 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:55.262445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:55.370641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1ff4-844b-46e9-9b85-2e8b3b3853e2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:55.412555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:55.413208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:55.413492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:55.413758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:55.414596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a, user.id=01f1266205ed4860ace0ba8c9dc6f7cc) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:24:55.414912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:55.416351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a839-26eb-4977-bd7b-986f11683d7c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:55.422107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 560/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:24:55 2022] GET /identity/v3/role_assignments?user.id=01f1266205ed4860ace0ba8c9dc6f7cc&scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a&role.id=294f84347b07412085947d751f52f815 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:57.602071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7e0d-f2b7-46e5-a3d7-cb5c84a63cb9 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:57.602663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7e0d-f2b7-46e5-a3d7-cb5c84a63cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:57.602663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7e0d-f2b7-46e5-a3d7-cb5c84a63cb9 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:57.604000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 558/1118] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:24:57.610588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:57.611369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:57.611517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:57.635837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:24:57.637046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:24:57.706895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:24:57.729685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7e0d-f2b7-46e5-a3d7-cb5c84a63cb9 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:57.837559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7e0d-f2b7-46e5-a3d7-cb5c84a63cb9 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:57.874796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:57.875581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:57.875858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:57.876129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] PATH_INFO: `/v3/roles/294f84347b07412085947d751f52f815` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:57.877682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] RBAC: Authorizing `identity:get_role(role_id=294f84347b07412085947d751f52f815)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:57.879060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:57.880430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 559/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:57 2022] GET /identity/v3/roles/294f84347b07412085947d751f52f815 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:57.886382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:57.983599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b952-69f9-47e1-9e2c-7d4d0051043b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:58.018264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:58.019129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:58.019406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:58.019680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] PATH_INFO: `/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:58.020941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] RBAC: Authorizing `identity:get_user(user_id=01f1266205ed4860ace0ba8c9dc6f7cc)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:58.022495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:58.024149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 562/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:24:57 2022] GET /identity/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:58.030177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:58.133934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317f9f-b4f8-4bb1-93e1-d6649071d1b8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:58.167164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:58.168013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:58.168292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:58.168591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:58.169820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:58.171256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ebbf0-7153-48b6-b004-f2591c01a3f1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:58.172998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 560/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:24:58 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:24:58.179717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:24:58.294662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb111f-88ed-4e7d-8f1a-a47d1bae56ae None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:24:58.328941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:24:58.329819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:24:58.330101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:24:58.330374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a/users/01f1266205ed4860ace0ba8c9dc6f7cc/roles/294f84347b07412085947d751f52f815` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:24:58.332991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] RBAC: Authorizing `identity:create_grant(project_id=89cf7efaf7c340138e1f3630d7af7b6a, user_id=01f1266205ed4860ace0ba8c9dc6f7cc, role_id=294f84347b07412085947d751f52f815)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:24:58.334569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff309c-9c0f-4721-8cbb-97b772cbbe23 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:24:58.352503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 563/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:24:58 2022] PUT /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a/users/01f1266205ed4860ace0ba8c9dc6f7cc/roles/294f84347b07412085947d751f52f815 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:00.534146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b768-af9d-4aa5-ae01-d1648f50f23f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:00.534762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b768-af9d-4aa5-ae01-d1648f50f23f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:00.534762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b768-af9d-4aa5-ae01-d1648f50f23f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:00.536090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 561/1124] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:00.542708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:00.543444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:00.543604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:00.569613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:00.570796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:00.639687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 564/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:00.667516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b768-af9d-4aa5-ae01-d1648f50f23f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:00.772409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b768-af9d-4aa5-ae01-d1648f50f23f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:00.805829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:00.806615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:00.806892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:00.807158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] PATH_INFO: `/v3/roles/294f84347b07412085947d751f52f815` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:00.808755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] RBAC: Authorizing `identity:get_role(role_id=294f84347b07412085947d751f52f815)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:00.810149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:00.811531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 562/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:00 2022] GET /identity/v3/roles/294f84347b07412085947d751f52f815 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:00.818536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:00.941512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c16c3-cde7-474a-8209-3efac97e466b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:00.984822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:00.985691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:00.985976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:00.986240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] PATH_INFO: `/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:00.987555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] RBAC: Authorizing `identity:get_user(user_id=01f1266205ed4860ace0ba8c9dc6f7cc)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:00.989035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:00.990736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 565/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:00 2022] GET /identity/v3/users/01f1266205ed4860ace0ba8c9dc6f7cc => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:00.997161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:01.092142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c87b4-996e-4841-9f9d-3aa60a3e252c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:01.125030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:01.125655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.125936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.126203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.190165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:01.191601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:01.287908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 563/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:01.294216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:01.400114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3229c4-e9d9-49c4-9805-6f0491ce3904 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:01.433605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:01.434448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.434726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.435000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] PATH_INFO: `/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.436224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] RBAC: Authorizing `identity:get_project(project_id=89cf7efaf7c340138e1f3630d7af7b6a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:01.437729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539834cb-3dd3-42f6-9ab0-8ad79c4b2a3f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:01.439424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 566/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:01 2022] GET /identity/v3/projects/89cf7efaf7c340138e1f3630d7af7b6a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:01.445906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:01.540953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77869b-3eb4-4b51-8293-f93b5eeb337e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:01.583074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:01.583743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.584027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.584301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.585161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] RBAC: Adding query filter params (role.id=294f84347b07412085947d751f52f815, scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a, user.id=01f1266205ed4860ace0ba8c9dc6f7cc) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:01.585473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:01.586914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b10ad-5b47-40da-8d80-c0454938628a None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:01.592956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 564/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:25:01 2022] GET /identity/v3/role_assignments?user.id=01f1266205ed4860ace0ba8c9dc6f7cc&scope.project.id=89cf7efaf7c340138e1f3630d7af7b6a&role.id=294f84347b07412085947d751f52f815 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:03.788712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2378ef-7a50-4207-828c-d02b6ae1807a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.789559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2378ef-7a50-4207-828c-d02b6ae1807a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.789559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2378ef-7a50-4207-828c-d02b6ae1807a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.791792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 567/1131] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:03.798605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.799128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.799231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.823548 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:03.824788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:03.892325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 565/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:03.917070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2378ef-7a50-4207-828c-d02b6ae1807a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.029195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2378ef-7a50-4207-828c-d02b6ae1807a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.063907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.064708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.064985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.065251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.066545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.068015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84fc4-01c6-41bd-ab9b-ee879e93ca36 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.069676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 568/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:04.075898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.174815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daac0d6-5986-4098-ba12-4b78c6a79ccb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.208364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766855-0faf-416c-84a3-329822866381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.209051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766855-0faf-416c-84a3-329822866381 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.209335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766855-0faf-416c-84a3-329822866381 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.209610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766855-0faf-416c-84a3-329822866381 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.210317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25766855-0faf-416c-84a3-329822866381 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.211747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25766855-0faf-416c-84a3-329822866381 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.239523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 566/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:06.461602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643c2f-35c5-42f9-9ab5-45cbb732e821 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.462190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643c2f-35c5-42f9-9ab5-45cbb732e821 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.462190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643c2f-35c5-42f9-9ab5-45cbb732e821 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.463541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 569/1135] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:06.470032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.470742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.470959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.489621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:06.490826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:06.558234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 567/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:06.586352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643c2f-35c5-42f9-9ab5-45cbb732e821 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.729799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643c2f-35c5-42f9-9ab5-45cbb732e821 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.767322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.768127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.768407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.768717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.770012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.771539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf64a2-b887-45ca-973c-22234d882926 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.773206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 570/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:06.779981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.879668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19212f8-09bf-468f-8e9c-6bdeee8f55e6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.913296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.913961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.914241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.914512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.915215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.916684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3538f1-d9f8-4bc0-abcb-90c78e560ba1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.940521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 568/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:25:06 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:09.156191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168ed5-947f-4041-bc6a-a389d70cac36 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.156763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168ed5-947f-4041-bc6a-a389d70cac36 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.156763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168ed5-947f-4041-bc6a-a389d70cac36 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.158135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 571/1139] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:09.163641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.164061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.164179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.182381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:09.183540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:09.263454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:09.286400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18168ed5-947f-4041-bc6a-a389d70cac36 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:09.395916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18168ed5-947f-4041-bc6a-a389d70cac36 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:09.429835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:09.430550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.430827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.431110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.441763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:09.449369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:09.450514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:09.451619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 572/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:09.458524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:09.556936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abdb04-14d7-422f-b514-efa933a09dbb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:09.590604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:09.591255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.591533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.591808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.592591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:09.592896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:09.594281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:09.602261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 570/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:25:09.611523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:09.718999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d110-9d10-4052-8a54-eab80f3218c2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:09.757873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:09.758747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.759028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.759301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] PATH_INFO: `/v3/users/0d760c63c77a4ece96522b168a98eaf3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.773072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d760c63c77a4ece96522b168a98eaf3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:09.774520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:09.776170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 573/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:09 2022] GET /identity/v3/users/0d760c63c77a4ece96522b168a98eaf3 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:09.782402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:09.888952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea057b-b4b5-48fb-a640-ae54d60f301d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:09.923302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:09.923955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.924231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.924535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.005571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.006995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.100994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 571/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:10.107237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.210073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a19b06-94b8-41f2-aa9e-264d2f31adf9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.243734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.244621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.244897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.245532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] PATH_INFO: `/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.246833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] RBAC: Authorizing `identity:get_project(project_id=3e05e66b23d743e8b499f9c0c1713e9c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.248271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707991-29af-43a8-a96f-bd6bad23c68a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.250004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 574/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:10 2022] GET /identity/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:10.256510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.362416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0488ff-3cf4-4254-9f9d-1d00215fa7c9 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.407485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.408549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.409046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.409503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.411068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=3e05e66b23d743e8b499f9c0c1713e9c, user.id=0d760c63c77a4ece96522b168a98eaf3) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:10.411396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.412845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500efac3-d90e-4bd9-874f-dc62764b4061 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.418788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 572/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:25:10 2022] GET /identity/v3/role_assignments?user.id=0d760c63c77a4ece96522b168a98eaf3&scope.project.id=3e05e66b23d743e8b499f9c0c1713e9c&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:12.595778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00de8-3545-434e-9b2f-512572118b28 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.596683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00de8-3545-434e-9b2f-512572118b28 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.596683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00de8-3545-434e-9b2f-512572118b28 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.598788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 575/1147] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:12.604470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.604908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.605010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.623305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:12.624551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:12.694680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 573/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:12.728607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b00de8-3545-434e-9b2f-512572118b28 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:12.829201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b00de8-3545-434e-9b2f-512572118b28 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:12.863034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:12.863771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.864084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.864361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.875334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:12.882950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:12.884011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:12.885065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:12.888600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 576/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:12.890248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:12.989460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde0ce-726e-414f-8992-f3955bbc63a0 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:13.022721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:13.023366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:13.023637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:13.023905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:13.024671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:13.024961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:13.026325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:13.034123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 574/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:25:13.041057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:13.151047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95189be-e3e9-459c-9d3e-a173e4f7ca4b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:13.184716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:13.185574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:13.185851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:13.186125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] PATH_INFO: `/v3/users/0d760c63c77a4ece96522b168a98eaf3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:13.187428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0d760c63c77a4ece96522b168a98eaf3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:13.188907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:13.190526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 577/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:13 2022] GET /identity/v3/users/0d760c63c77a4ece96522b168a98eaf3 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:13.199273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:13.300299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663194d8-3c53-4601-92d0-8b3288442d46 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:13.333430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:13.334274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:13.334554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:13.334824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] PATH_INFO: `/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:13.336056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] RBAC: Authorizing `identity:get_project(project_id=3e05e66b23d743e8b499f9c0c1713e9c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:13.337524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0881fd-df70-4c46-8c8c-0827e452e269 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:13.339204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 575/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:13 2022] GET /identity/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:13.345858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:13.454690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec2a-d890-438f-a45e-880b54ebc8e0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:13.491530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:13.492393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:13.492708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:13.492974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] PATH_INFO: `/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c/users/0d760c63c77a4ece96522b168a98eaf3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:13.495519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] RBAC: Authorizing `identity:create_grant(project_id=3e05e66b23d743e8b499f9c0c1713e9c, user_id=0d760c63c77a4ece96522b168a98eaf3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:13.496971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4383c-5b3c-40c0-9f5c-429123d19b4a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:13.517410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 578/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:25:13 2022] PUT /identity/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c/users/0d760c63c77a4ece96522b168a98eaf3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:15.704126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa528cd-9c77-414a-a446-a6a499f326b4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:15.704679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa528cd-9c77-414a-a446-a6a499f326b4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:15.704679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa528cd-9c77-414a-a446-a6a499f326b4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:15.706082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 576/1154] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:15.712784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:15.713539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:15.713681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:15.734643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:15.735841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:15.804881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 579/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:15.832609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa528cd-9c77-414a-a446-a6a499f326b4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:15.935329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa528cd-9c77-414a-a446-a6a499f326b4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:15.968366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:15.969182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:15.969459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:15.969729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:15.980113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:15.987713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:15.988980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:25:15.990056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 577/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:15.998010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.107707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb8781-f701-403a-a118-15a37eb933ec None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.142185 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.142845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.143126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.143405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.144151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:16.144472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.145929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.153744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 580/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:16.159700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.264492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df060f-6881-42aa-b756-af7434f77762 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.300087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.301008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.301290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.301568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] PATH_INFO: `/v3/users/0d760c63c77a4ece96522b168a98eaf3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.302877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=0d760c63c77a4ece96522b168a98eaf3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.304323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.305979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 578/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:16 2022] GET /identity/v3/users/0d760c63c77a4ece96522b168a98eaf3 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:16.312587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.423295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6670-0460-4f0b-85ae-fc891130fb8b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.456402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.457072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.457381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.457658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.536717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.538096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.631028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 581/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:16.639321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.741589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0398f-0e72-40d9-a050-19652c7fdbf1 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.778292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.779142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.779413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.779682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] PATH_INFO: `/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.780985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] RBAC: Authorizing `identity:get_project(project_id=3e05e66b23d743e8b499f9c0c1713e9c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.782410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b52c81-dbf2-46bb-bbd5-806a1b0b1109 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.784086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 579/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:16 2022] GET /identity/v3/projects/3e05e66b23d743e8b499f9c0c1713e9c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:16.791034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.893938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89ca87-8b89-4ee9-b947-f33d28e4ce48 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.929326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.929972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.930246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.930516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.931333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=3e05e66b23d743e8b499f9c0c1713e9c, user.id=0d760c63c77a4ece96522b168a98eaf3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:16.931634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.933103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a573-7643-4fbd-9935-260d5310b306 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.938783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 582/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:25:16 2022] GET /identity/v3/role_assignments?user.id=0d760c63c77a4ece96522b168a98eaf3&scope.project.id=3e05e66b23d743e8b499f9c0c1713e9c&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:19.125235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7901-17b0-474f-a82c-2896abd7ebed None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.125783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7901-17b0-474f-a82c-2896abd7ebed None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.125783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7901-17b0-474f-a82c-2896abd7ebed None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.127040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 580/1162] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:19.132578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.133106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.133106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.151337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:19.152522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:19.222932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 583/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:19.245456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa7901-17b0-474f-a82c-2896abd7ebed None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:19.365272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa7901-17b0-474f-a82c-2896abd7ebed None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:19.400629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:19.401238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.401547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.401813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.466481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:19.467920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:19.580793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 581/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:19.590302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:19.703288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8c73e-9624-41de-9cd8-a481e99805a3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:19.736742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:19.737579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.737848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.738121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.745398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:19.746833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-05fcd622-1888-450e-932a-d4197babe6ce None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:19.760726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:19.761915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:19.763528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 584/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:25:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:19.770853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:19.869649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f63b0-cd7d-4885-bb10-66b648f1af9b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:19.903318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:19.903962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.904241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.904541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.905259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:19.905566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:19.906929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3846-33b3-4ba0-abf6-febb7e34f1d2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:19.914029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 582/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 16 20:25:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:22.125544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853127-d14f-47e2-8b42-2a0e30378f2c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:22.126075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853127-d14f-47e2-8b42-2a0e30378f2c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:22.126075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853127-d14f-47e2-8b42-2a0e30378f2c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:22.127407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 585/1167] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:22.134041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a81db-a73a-4145-8af5-24720292b036 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:22.134802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a81db-a73a-4145-8af5-24720292b036 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:22.134932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a81db-a73a-4145-8af5-24720292b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:22.157178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bb2a81db-a73a-4145-8af5-24720292b036 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:22.158380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bb2a81db-a73a-4145-8af5-24720292b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:22.229165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:22.264325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853127-d14f-47e2-8b42-2a0e30378f2c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:22.379415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853127-d14f-47e2-8b42-2a0e30378f2c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:22.414088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:22.414744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:22.415024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:22.415295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:22.416039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:22.417669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be648070-d255-41d0-b475-3caea0ace216 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:22.435129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 586/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon May 16 20:25:22 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:24.627288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5682-cc5b-47b5-9cac-e0181e2933a4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:24.628229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5682-cc5b-47b5-9cac-e0181e2933a4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:24.628229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5682-cc5b-47b5-9cac-e0181e2933a4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.630487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 584/1170] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:24.635863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:24.636301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:24.636407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.654801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:24.655993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:24.725760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 587/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:24.749536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc5682-cc5b-47b5-9cac-e0181e2933a4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:24.863437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc5682-cc5b-47b5-9cac-e0181e2933a4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:24.901402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:24.902636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:24.903010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:24.903372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] PATH_INFO: `/v3/domains/3841972062f845cb98ee54ff7ce3e9dd` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.920647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3841972062f845cb98ee54ff7ce3e9dd)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:24.922934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e2c9-4d84-41c5-ae54-80e70102aaf2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:24.925557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 585/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon May 16 20:25:24 2022] GET /identity/v3/domains/3841972062f845cb98ee54ff7ce3e9dd => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:24.931543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.029702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0da7-2a68-40dc-88a2-735bab76ab32 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.064429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.065111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.065390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.065660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.066395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.067852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316c4a-3991-47ce-9af1-fcd195250bf3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.098011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 588/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:25:24 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:27.312908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46752-9393-4b17-98e4-62ad7ac50041 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.313495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46752-9393-4b17-98e4-62ad7ac50041 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.313495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46752-9393-4b17-98e4-62ad7ac50041 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.314847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 586/1174] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:27.320556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.320992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.321086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.339486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:27.340714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:27.409146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 589/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:25:27.433569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f46752-9393-4b17-98e4-62ad7ac50041 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.535886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f46752-9393-4b17-98e4-62ad7ac50041 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.569526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.570313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.570588 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.570861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] PATH_INFO: `/v3/domains/3841972062f845cb98ee54ff7ce3e9dd` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.572165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3841972062f845cb98ee54ff7ce3e9dd)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.573640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90544f0b-63ff-4b2b-9ccc-cfc275f89878 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:27.575216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 587/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon May 16 20:25:27 2022] GET /identity/v3/domains/3841972062f845cb98ee54ff7ce3e9dd => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:27.581807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.692731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff639-b0cb-4b9b-9c07-2550623524ce None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.726334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.726999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.727273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.727541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.728235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.729705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1cdea-f17b-4b77-ad2b-49af309ba84c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:27.751953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 590/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:25:27 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:29.972776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768974-3524-4313-a494-01db3b875075 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.973312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768974-3524-4313-a494-01db3b875075 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.973312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768974-3524-4313-a494-01db3b875075 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.974614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 588/1178] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:29.981344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.982063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.982341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.005248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:30.006424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:30.074011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 591/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:30.097462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768974-3524-4313-a494-01db3b875075 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.202411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768974-3524-4313-a494-01db3b875075 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.236371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.237300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.237583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.237852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.248243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:30.255815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:30.257078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:25:30.258096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 589/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:30.263380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.361702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31341c3e-eca7-4f7b-9c82-3ba5de169740 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.395917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.396603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.396887 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.397161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.397904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:30.398212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.399581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.407519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 592/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:30.414438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.520181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e3e7-d231-4ced-902a-1fa0cf02b5ba None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.553288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.554142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.554421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.554701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] PATH_INFO: `/v3/users/4caa497508124bb39fa5d842caad00f4` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.567876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] RBAC: Authorizing `identity:get_user(user_id=4caa497508124bb39fa5d842caad00f4)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.569356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.570987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 590/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/users/4caa497508124bb39fa5d842caad00f4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:30.577317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.682548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b3cd-c30a-4639-9c8a-de16df3c0f40 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.719362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.720001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.720283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.720596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.785230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.786612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.882199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 593/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:30.889322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.990976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b0c3-4543-4c3a-ae62-3e79f1e2c8bc None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.028619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.029470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.029749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.030022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] PATH_INFO: `/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.031333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] RBAC: Authorizing `identity:get_project(project_id=56ee01b6781f4f5d919cb6b994ca66ce)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.032805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14fb48-cc74-4684-9a50-269d78e34fff None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.034537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 591/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:31.041210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.144053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a07ee-8614-4f4f-b51e-9e6c56fd6368 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.177608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.178243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.178521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.178792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.179609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=56ee01b6781f4f5d919cb6b994ca66ce, user.id=4caa497508124bb39fa5d842caad00f4) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:31.179913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.181389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a35f1-4440-46e4-a6fc-4253d42f254a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.186675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 594/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:25:31 2022] GET /identity/v3/role_assignments?user.id=4caa497508124bb39fa5d842caad00f4&scope.project.id=56ee01b6781f4f5d919cb6b994ca66ce&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:33.356772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ea9f-54a0-4f66-b446-258203ab2e1a None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.357705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ea9f-54a0-4f66-b446-258203ab2e1a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.357705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ea9f-54a0-4f66-b446-258203ab2e1a None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.359841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 592/1186] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:33.366257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.366965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.367075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.393922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:33.395135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:33.461892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 595/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:25:33.484838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9ea9f-54a0-4f66-b446-258203ab2e1a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:33.596560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9ea9f-54a0-4f66-b446-258203ab2e1a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:33.629899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:33.630650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.630931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.631204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.642074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:33.649718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:33.650818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:25:33.651692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 593/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:33.657396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:33.761601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73564db-5516-4ceb-ae2a-18a2f8058d91 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:33.795191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:33.795846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.796128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.796401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.797180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:33.797489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:33.798864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:33.809643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 596/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:33.816820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:33.929424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c33830-d72c-403f-bfb9-717a253b78ee None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:33.962907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:33.963776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.964053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.964329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] PATH_INFO: `/v3/users/4caa497508124bb39fa5d842caad00f4` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.965661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] RBAC: Authorizing `identity:get_user(user_id=4caa497508124bb39fa5d842caad00f4)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:33.967112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:33.968788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 594/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:33 2022] GET /identity/v3/users/4caa497508124bb39fa5d842caad00f4 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:33.975119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:34.085759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6078f9-2fa9-4658-b71e-9fbf8f6046fb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:34.121498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:34.122340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:34.122622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:34.122898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] PATH_INFO: `/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:34.124203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] RBAC: Authorizing `identity:get_project(project_id=56ee01b6781f4f5d919cb6b994ca66ce)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:34.125698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46b038-143f-4ec7-8821-ae2dd18b1f72 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:34.127393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 597/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:33 2022] GET /identity/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:34.136964 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:34.256791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414987c2-db1f-4bdc-b66b-0c6ba5af3f9e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:34.290465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:34.291358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:34.291638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:34.291915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] PATH_INFO: `/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce/users/4caa497508124bb39fa5d842caad00f4/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:34.294144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] RBAC: Authorizing `identity:create_grant(project_id=56ee01b6781f4f5d919cb6b994ca66ce, user_id=4caa497508124bb39fa5d842caad00f4, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:34.295584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f109-fc0d-44fb-a26f-bf72bfcda765 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:34.311268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 595/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:25:34 2022] PUT /identity/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce/users/4caa497508124bb39fa5d842caad00f4/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:36.453990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b87f38-b887-4199-9946-93f145a91067 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.454874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b87f38-b887-4199-9946-93f145a91067 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.454874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b87f38-b887-4199-9946-93f145a91067 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.456739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 598/1193] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:36.462229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.462669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.462769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.481616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:36.482789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:36.548586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 596/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:25:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:25:36.571817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b87f38-b887-4199-9946-93f145a91067 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:36.694169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b87f38-b887-4199-9946-93f145a91067 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:36.729523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:36.730247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.730529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.730803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.741384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:25:36.749328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:25:36.750404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:25:36.751287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 599/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:25:36.759051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:36.855255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961c4f-0355-413a-8258-33ae5521ebd6 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:36.893996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:36.894648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.894928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.895202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.895952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:36.896260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:36.897659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:36.906387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 597/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:36.914804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.026052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b4d3-6f45-41b2-9496-b40526402aeb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.060860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.061716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.061990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.062258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] PATH_INFO: `/v3/users/4caa497508124bb39fa5d842caad00f4` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.063565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] RBAC: Authorizing `identity:get_user(user_id=4caa497508124bb39fa5d842caad00f4)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.065054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.066709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 600/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 16 20:25:36 2022] GET /identity/v3/users/4caa497508124bb39fa5d842caad00f4 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:25:37.073017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.180504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7561-5f11-4ba9-935a-a2e3fc02cb4d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.213431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.214065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.214342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.214612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.286178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.287565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.383677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 598/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:25:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:25:37.390074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.489962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2bfa-916c-437c-a00c-c5621d50f4bc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.523943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.524833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.525112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.525380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] PATH_INFO: `/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.526676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=56ee01b6781f4f5d919cb6b994ca66ce)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.528106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3138-0ff8-42ea-8c2d-607ecfeae8a5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.529847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 601/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 16 20:25:37 2022] GET /identity/v3/projects/56ee01b6781f4f5d919cb6b994ca66ce => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:37.537610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.646327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53031eab-e6d1-4699-bd04-e54c0abf62e3 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.681592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.682245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.682531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.682806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.683646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=56ee01b6781f4f5d919cb6b994ca66ce, user.id=4caa497508124bb39fa5d842caad00f4) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:37.683957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.685436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0d4d-2970-4711-bdeb-aa2bbcac29ea None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.691394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 599/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:25:37 2022] GET /identity/v3/role_assignments?user.id=4caa497508124bb39fa5d842caad00f4&scope.project.id=56ee01b6781f4f5d919cb6b994ca66ce&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:38.260674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0c1c-31ea-4317-9f0a-8ca34b9e020e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.261339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0c1c-31ea-4317-9f0a-8ca34b9e020e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.261339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0c1c-31ea-4317-9f0a-8ca34b9e020e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.262927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 602/1201] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:26:38.269298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.269973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.269973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.289980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:38.291368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:38.376659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 600/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:26:38.394661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b0c1c-31ea-4317-9f0a-8ca34b9e020e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:38.514771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b0c1c-31ea-4317-9f0a-8ca34b9e020e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:38.551236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:38.552205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.552606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.552972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.563392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:38.565050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:38.582505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:38.583748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:38.584907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:38.584907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:38.584907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:38.584907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:38.584907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 603/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:38.590444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:38.707314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46203-13c4-4d5f-a6ad-f7348015ef5b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:38.746275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:38.747055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.747364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.747721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.748673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:38.749075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:38.750546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ac16-1b33-4961-8c11-b74b129226c1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:38.763055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 601/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:38.771133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:38.890157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f745c-c08a-4a7e-b2d8-52f0d87feb9d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:38.934561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:38.936535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.936535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.936535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.936810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:38.938378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a6c4-a382-4dd8-9a45-df4759112085 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:38.961535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 604/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 16 20:26:38 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:41.491744 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd80c7-7523-4430-8b2f-bc7592e8110f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:41.493723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd80c7-7523-4430-8b2f-bc7592e8110f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:41.493723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd80c7-7523-4430-8b2f-bc7592e8110f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:41.493945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 602/1206] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:26:41.500062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:41.500802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:41.501151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:41.519477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:41.520716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:41.592956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 605/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:26:41.618324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd80c7-7523-4430-8b2f-bc7592e8110f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:41.727589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd80c7-7523-4430-8b2f-bc7592e8110f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:41.763204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:41.763962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:41.764243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:41.764545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:41.775436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:26:41.783333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:41.784502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:41.786104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 603/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:41.791583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:41.898716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0e0af-3dbe-4815-97f1-03d16e79f3b7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:41.932949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:41.933616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:41.933898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:41.934172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:41.934943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:41.935295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:41.936748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:41.945315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 606/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:41.951657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.066443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cceade-481f-41d9-87ca-a61138954086 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.104735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.105892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.105892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.106238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.118786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.120364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:42.139042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:42.140847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:42.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:42.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:42.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:42.142193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:42.145292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 604/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:42.146515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.251940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9884-fd6d-4155-babb-d704892cff2b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.287418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.288097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.288376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.288680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.289403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:42.289702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.291066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.304743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 607/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:42.311003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.432787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb272a5a-509b-45f3-a175-2e5449e6a25c None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.472991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.473871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.474227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.474578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] PATH_INFO: `/v3/users/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.483682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.485332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:26:42.501563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:42.503149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:42.504173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 605/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:42.509062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.623109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350e3e-98f1-42f0-82ca-7517f972019d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.662943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.663655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.663942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.664216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.665246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:42.665583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.667195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.686545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 608/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:42.692182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.801075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cbf14-7d12-4be1-a7a3-73045aed18de None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.835135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.835790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.836057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.836325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.908836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.910433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.022569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 606/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:26:43.028884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:43.136290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e85b-89bf-4f3c-9d6c-45347e17f88f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:43.171817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:43.172745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:43.173027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:43.173294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:43.184113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:43.185689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:43.203327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:43.204284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:43.205324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:43.205324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:43.205324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:43.205324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:43.208619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 609/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:43.210551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:43.312603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018fcc-7fb5-46c7-afb0-32157be3aa1d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:43.346216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:43.346910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:43.347166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:43.347556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:43.348152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:43.348467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:43.349988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.361676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 607/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:43.368386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:43.477569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4afe-0518-4c15-b253-075dd6ea2317 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:43.518675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:43.519633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:43.519919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:43.520195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:43.530734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:43.531137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:26:43.547132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:43.548494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:43.549587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 610/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:43.555261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:43.657151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408c87-a899-4374-a706-47f745f0d24e None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:43.689794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:43.690553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:43.690905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:43.691248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:43.693193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:43.693536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:43.694933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601234e-647c-47c0-a56e-cc166894c5f7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.707201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 608/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:43.713238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:43.816534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756cec0-0e77-4a77-96ec-1e6b8190a3eb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:43.851562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75767-bc37-4908-9846-0492a680168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:43.852215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75767-bc37-4908-9846-0492a680168e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:43.852545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75767-bc37-4908-9846-0492a680168e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:43.852825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75767-bc37-4908-9846-0492a680168e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:43.853662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75767-bc37-4908-9846-0492a680168e None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=fec791a20cf54413ab307c7a66892259) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:43.853976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75767-bc37-4908-9846-0492a680168e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:43.855423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75767-bc37-4908-9846-0492a680168e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:43.872471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 611/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:26:43 2022] GET /identity/v3/role_assignments?user.id=fec791a20cf54413ab307c7a66892259&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:46.257677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bf73-375b-4938-a285-942ba17d73d4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:46.258256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bf73-375b-4938-a285-942ba17d73d4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:46.258357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bf73-375b-4938-a285-942ba17d73d4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:46.259847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 609/1220] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:26:46.266270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:46.266766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:46.267048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:46.286994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:46.288195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:46.354952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 612/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:26:46.381409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bf73-375b-4938-a285-942ba17d73d4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:46.482026 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bf73-375b-4938-a285-942ba17d73d4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:46.515796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:46.516507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:46.516811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:46.517083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:46.527302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:26:46.534977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:46.536418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:46.537324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 610/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:26:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:46.542577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:46.647492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e074f-13dc-4f21-b823-9d2679caff0d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:46.689071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:46.689744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:46.690020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:46.690288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:46.691061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:46.691364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:46.692769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:46.701801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 613/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:26:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:46.707703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:46.808062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad232e9b-b3f5-4bb5-853a-5e6e629c13b6 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:46.842788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:46.843598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:46.843895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:46.844177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:46.855123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:46.856609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:46.874456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:46.880365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:46.881384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:46.881384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:46.881384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:46.881384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:46.881384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 611/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:46.881668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:46.982998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600039-1f05-402a-b2ae-22dd3de9e304 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.025640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.026670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.027548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.028280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.029551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:47.030032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.032016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.052480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 614/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:47.053899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:47.161629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171258-5111-43f2-8d4f-2bb65cff97d2 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.196271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.197341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.197674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.197996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.205873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.207334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:26:47.223122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:47.224256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:47.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 612/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:47.230762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:47.345494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fde9a-6edc-4992-a038-570e4b1f4e9c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.388792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.390055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.390339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.390759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.392483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:47.392892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.394789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.413972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 615/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:47.419892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:47.540976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe70f-a4c0-4ffa-81a0-e6352771b6b7 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.580184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.581097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.581399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.581800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.593681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.595304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:47.614364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:47.615502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:47.616579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:47.616579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:47.616579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:47.616579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:47.616579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 613/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:47.621664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:47.733453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089be88-e0c2-4fdc-8b9b-0bd69eafb32c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.774562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.775209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.775560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.775814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.776577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:47.776878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.778500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.792488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 616/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:47.798634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:47.909875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f5b0-e2a2-449e-8e5d-fddf056f4a91 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:47.948953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:47.949769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.950052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.950329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.958158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:47.960147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:26:47.975057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:47.976024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:47.977090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 614/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:47.982488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:48.103686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841154cf-e5f8-4927-a900-50a3a764ec9e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:48.145821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:48.146668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:48.146946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:48.147215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:48.148000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:48.148375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:48.149879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ead59d-fb6b-496e-aea7-c7c3ce7816fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:48.162589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 617/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:48.170108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:48.284447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75046-3cc4-44b6-86a6-6510a14131ec None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:48.318198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:48.319304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:48.319642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:48.319913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/fec791a20cf54413ab307c7a66892259/roles/c71e3339c32e496e9b30b50d835f889d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:48.335080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=fec791a20cf54413ab307c7a66892259, role_id=c71e3339c32e496e9b30b50d835f889d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:48.336787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441b36d-e9ce-4eee-ac86-37e8ed273bdf None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:48.351938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 615/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:26:48 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/fec791a20cf54413ab307c7a66892259/roles/c71e3339c32e496e9b30b50d835f889d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:50.630886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0361d1-06f9-4670-92ff-66d0a3634bf0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:50.631516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0361d1-06f9-4670-92ff-66d0a3634bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:50.631516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0361d1-06f9-4670-92ff-66d0a3634bf0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:50.633166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 618/1233] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:26:50.641231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:50.641862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:50.641862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:50.658947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:50.660134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:50.723826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 616/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:26:50.747098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0361d1-06f9-4670-92ff-66d0a3634bf0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:50.859780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0361d1-06f9-4670-92ff-66d0a3634bf0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:50.901052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:50.901851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:50.902131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:50.902402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:50.913163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:26:50.921467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:50.922544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:50.923485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 619/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 16 20:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:50.931283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.040863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5234eb7-3ac9-4120-850d-67ef802dcce5 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.085141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.085919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.086197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.086526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.087361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:51.087723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.089104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.097895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 617/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 16 20:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:51.103989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.215055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99097-5956-4a23-a979-883684cf1f4f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.251196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.251997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.252290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.252595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.264897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.266525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:51.284506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:51.285665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:51.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:51.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:51.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:51.286805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:51.290569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 620/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:51.291692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.394524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abf592-6a58-4b91-ac3a-ead2210e54b5 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.429920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.430688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.431042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.431389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.432285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:51.432731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.434767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.448959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 618/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:51.454918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.577024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32f17b-9291-47a2-90a6-c78ea9e7b401 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.614352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.615164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.615449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.615722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.623311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.624800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:26:51.639074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:51.640800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:51.641942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 621/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:51.646175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.751079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3fa4-1b4c-462e-a039-820bfe349485 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.786417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.787100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.787386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.787663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.788562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:51.788874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.790346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.810219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 619/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:26:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:51.817605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.926727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aea1b5-641d-482d-83ad-0c4b1ffde58e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.966313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.967035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.967329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.967771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.050483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.051954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.161191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 622/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:26:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:26:52.166934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.266692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc4f2-e543-4002-9cb8-31b158981cef None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.298949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.299749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.300024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.300305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.311767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.313567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:52.334780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:52.335949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:52.337106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:52.337106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:52.337106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:52.337106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:52.337106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 620/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:52.343022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.451891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377497-087a-4532-a693-b55dbc89ec47 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.488616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.489397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.489648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.489946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.490717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:52.491043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.492508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.504551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 623/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:52.510073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.609768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007409-3597-4654-900d-3fd7b13311f4 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.643921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.644859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.645139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.645389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.652706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.654278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:26:52.668483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:52.669756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:52.671093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:52.676461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 621/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:52.676592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.790274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda5f54-8ddd-44a5-9d55-a97b8b1e178e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.828141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.828829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.829117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.829675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.830570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:52.830912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.832569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099be6dc-2e5d-4f14-98e3-6885e5d55cac None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.845956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 624/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:52.852005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.958688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e136b-2ff8-4ce6-8784-0c9b0102772f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.993031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.993739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.994055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.994324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.995262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] RBAC: Adding query filter params (role.id=c71e3339c32e496e9b30b50d835f889d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=fec791a20cf54413ab307c7a66892259) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:52.995571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.997119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149293b-9e67-4cbb-bd75-56831d87bdbd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.004076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 622/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/role_assignments?user.id=fec791a20cf54413ab307c7a66892259&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=c71e3339c32e496e9b30b50d835f889d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:55.469414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35226-86e3-41a7-8275-446d994cc6a4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.470097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35226-86e3-41a7-8275-446d994cc6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.470097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35226-86e3-41a7-8275-446d994cc6a4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.471518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 625/1247] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:26:55.478048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.478704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.478704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.497339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:55.498579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:55.575494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 623/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:26:55.602545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35226-86e3-41a7-8275-446d994cc6a4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.719188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35226-86e3-41a7-8275-446d994cc6a4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.758964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.759673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.759973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.760209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.771342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:26:55.779732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:55.780864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:55.782588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 626/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:55.787994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.900138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac4d0-4416-46e5-a1ea-bafb27adf405 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.940323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.941128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.941408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.941681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.942436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:55.942736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.944238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.952641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 624/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:55.958421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.082444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53a8f-414f-44ce-b29a-3d095045f4c1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.118913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.119821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.120201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.120527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.131820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.133335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:56.151134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:56.152361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:56.153408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:56.153408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:56.153408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:56.153408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:56.153408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 627/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:56.158470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.262960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e53d7-28cd-48eb-ac24-0abc87ee810f None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.300951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.301739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.302120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.302390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.303243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:56.303544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.304942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.317550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 625/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:56.323644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.435432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a7d-d1c7-4fe0-a47b-7ba8ae5d153d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.470839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.471694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.472010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.472309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.480923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.482480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:26:56.498189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:56.499553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:26:56.500838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 628/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:56.505486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.614213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c94357-6ddf-4f86-bfbe-e27471b21ea0 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.651300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.651991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.652271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.653172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.654030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:56.654346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.655935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.677848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 626/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:56.683626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.786025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e161a0-a855-4dbc-8842-9e45cb0f8c0a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.819421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.820086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.820347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.820645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.887364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.888953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.003670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 629/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:26:57.011162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.123477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced305-b122-499e-a64b-4975edadff14 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.159386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.160241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.160542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.160809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.171543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.173262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:26:57.193017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:57.194053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:57.194979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:26:57.194979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:26:57.194979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:26:57.194979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:57.194979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 627/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:26:57.201158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.306656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6679f-1c94-4a14-8ccb-f0b0409998a1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.343805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.344726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.345031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.345285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.346098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:57.346550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.348171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.361031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 630/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:57.368040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.487027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72971-36bc-4795-a9d5-68d30466ec92 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.524409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.525298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.525652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.525965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.533804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.535531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:26:57.550655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:26:57.551794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:26:57.557930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 628/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:26:57.558574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.658416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1620d-bb1d-4e9d-88e4-40109d4cf906 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.691450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.692094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.692372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.692669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.693450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:57.693753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.695189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca9b0a-f946-44e2-984d-81747c7d391d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.707752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 631/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:57.713947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.816880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aa4db-dce3-425b-91ec-305f42d757d8 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.852332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.853050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.853361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.853650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.854493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=fec791a20cf54413ab307c7a66892259) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:57.854824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.856503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f08d6-e8f3-465c-be0d-e6b084892f83 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.862444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 629/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/role_assignments?user.id=fec791a20cf54413ab307c7a66892259&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:00.056155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9fd70-42d8-494c-a613-72f95580ac73 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.056721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9fd70-42d8-494c-a613-72f95580ac73 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.056721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9fd70-42d8-494c-a613-72f95580ac73 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.058045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 632/1261] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:00.063574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.063996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.064114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.081176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:00.082351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:00.149637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 630/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:27:00.172203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9fd70-42d8-494c-a613-72f95580ac73 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.284460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9fd70-42d8-494c-a613-72f95580ac73 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.318111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.318829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.319111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.319382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.329895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:27:00.337541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:00.338645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:00.340057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 633/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:00.347967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.459261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48186b-8b60-4f34-8ea6-5a2147a77bbb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.492918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.493567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.493848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.494113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.494856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:00.495167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:00.496631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:00.504529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 631/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:00.513191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.612043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba4f-ec7f-4f04-8717-3ae380f720b1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.645579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.646372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.646651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.646921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.657810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:00.659287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:27:00.676196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:00.677267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:00.678188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:27:00.678188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:27:00.678188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:00.678188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:00.678188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 634/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:00.685217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.783803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949666e-4dfb-4434-a749-f90d083b86ee None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.817363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.818006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.818280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.818544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.819249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:00.819544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:00.820943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:00.832330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 632/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:00.842068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.954786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b87a-9267-42dc-8dd5-29512a061729 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.988205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.989030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.989286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.989577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.001443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.003679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:27:01.023489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:01.030186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:01.031621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 635/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:01.032458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.134172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27a06b-025c-48bd-a2be-32a05ac5f2be None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:01.167353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:01.168016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:01.168341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:01.168645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.169476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:01.169781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.171210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.187751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 633/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:27:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:01.196856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.314244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5467-b593-48b9-9f2f-013f36aa962b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:01.349365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:01.350139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:01.350414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:01.350681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.361348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.363133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:27:01.379952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:01.381001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:01.382257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:27:01.382257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:27:01.382257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:01.382257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:01.382257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 636/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:01.388743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.485766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9ba7-de08-456e-8857-5dd570279c9d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:01.522757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:01.523778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:01.524209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:01.524637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.525778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:01.526253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.528235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.539809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 634/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:01.545699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.650002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a03f7-fe95-4345-83f6-7aa022890794 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:01.683768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:01.684601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:01.684883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:01.685152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.691916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.693418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:27:01.707801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:01.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:01.717301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 637/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:01.717957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.830606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e0a1-240e-4748-8c18-c9e3ea80a476 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:01.866746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:01.867398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:01.867673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:01.867944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:01.868768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:01.869077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:01.870520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c642a-9920-4c27-ad76-03000e3ca3eb None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:01.882297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 635/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:01.888722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:01.988838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682fe1-8bad-4497-9970-2bda75deeebb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:02.030273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:02.031286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:02.031601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:02.031947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] PATH_INFO: `/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/fec791a20cf54413ab307c7a66892259/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:02.034492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] RBAC: Authorizing `identity:create_grant(project_id=faf1841d6fce4ccdb88cd306b21ac996, user_id=fec791a20cf54413ab307c7a66892259, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:02.036396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c02c3f-df14-4ad9-bcbd-067e16e6c03b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:02.051295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 638/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 16 20:27:01 2022] PUT /identity/v3/projects/faf1841d6fce4ccdb88cd306b21ac996/users/fec791a20cf54413ab307c7a66892259/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:04.236069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448964-1df4-47b8-aa9a-6f18955f90c2 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:04.237001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448964-1df4-47b8-aa9a-6f18955f90c2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:04.237001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448964-1df4-47b8-aa9a-6f18955f90c2 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:04.239561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 636/1274] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:04.245043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:04.245488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:04.245583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:04.263006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:04.264190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:04.336597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 639/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:27:04.374094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448964-1df4-47b8-aa9a-6f18955f90c2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:04.486597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448964-1df4-47b8-aa9a-6f18955f90c2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:04.534444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:04.535238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:04.535520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:04.535793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:04.546687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:27:04.554109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:04.555279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:04.556172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 637/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 16 20:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:04.561579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:04.663258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd5e0-945f-40f8-bcee-6eddaa00a190 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:04.699324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:04.699993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:04.700278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:04.700591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:04.701349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:04.701656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:04.703071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:04.711475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 640/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 16 20:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:04.717553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:04.819735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44861-8dc7-4256-abe7-7beed07c1918 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:04.853793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:04.854563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:04.854843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:04.855117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:04.866942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:04.868790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:27:04.886685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:04.887727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:04.888840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:27:04.888840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:27:04.888840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:04.888840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:04.888840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 638/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:04.894245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:05.003858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdc603-1834-4493-aec9-944d21f5374e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:05.040749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:05.041570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:05.042007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:05.042236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:05.043098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:05.043482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:05.045191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:05.060084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 641/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:05.066192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:05.179332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339d9f7-25f8-4465-9d50-873d73936f84 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:05.215209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:05.216009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:05.216286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:05.216589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:05.224037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:05.225492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:27:05.239854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:05.241392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:05.242495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 639/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:05.248179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:05.352249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8674-02dd-4fde-bfc2-8aeb4a481081 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:05.387050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:05.387698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:05.387977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:05.388249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:05.389117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:05.389419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:05.390869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:05.407382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 642/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 16 20:27:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:05.418686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:05.531906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e680-b6ee-44c6-95a7-1eb9210e5062 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:05.565820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:05.566444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:05.566727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:05.566972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:05.639490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:05.640994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:05.739178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 640/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 16 20:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:27:05.745141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:05.845662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220728f5-ff84-473e-9812-6f7ed311f45e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:05.880543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:05.881337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:05.881621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:05.881894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:05.893822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:05.895294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:27:05.913705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:05.914716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:05.915639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:27:05.915639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:27:05.915639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:27:05.915639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:05.915639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 643/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:05.923558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.036975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1bc52-9432-48ef-8b42-33882261960d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.072118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.072812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.073076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.073349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.074134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:06.074440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.075787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.089222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 641/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 16 20:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:06.095458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.208900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9582c-0a52-4449-b4d9-9fa2f55ec2e0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.252074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.253584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.254093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.254608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.264497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.266010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:27:06.285653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:06.286782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 20:27:06.287843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 644/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 16 20:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:06.293779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.417138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405b8f-7378-498f-b7b7-8134e773a0dd None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.452941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.453605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.453885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.454163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.454946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:06.455257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.456722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa267b-7b63-4568-b8fa-30dbb79fd0c1 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.468571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 642/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 16 20:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:06.475025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.574693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac69c-5787-4198-8360-b085f5ed47b9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.608085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.608742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.609031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.609298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.610124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] RBAC: Adding query filter params (role.id=4f500164fa794f84afa94241394a2b5d, scope.project.id=faf1841d6fce4ccdb88cd306b21ac996, user.id=fec791a20cf54413ab307c7a66892259) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:06.610432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.611877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a78a7-e06e-4a9b-a292-2c22eeb866d7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.618043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 645/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 16 20:27:06 2022] GET /identity/v3/role_assignments?user.id=fec791a20cf54413ab307c7a66892259&scope.project.id=faf1841d6fce4ccdb88cd306b21ac996&role.id=4f500164fa794f84afa94241394a2b5d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:08.800282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321302e-2803-4a93-80a8-7b41aed54742 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:08.801192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321302e-2803-4a93-80a8-7b41aed54742 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:08.801192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321302e-2803-4a93-80a8-7b41aed54742 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:08.803354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 643/1288] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:08.809360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:08.809776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:08.809868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:08.827618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:08.828873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:08.893979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 646/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:27:08.915359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321302e-2803-4a93-80a8-7b41aed54742 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:09.025286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321302e-2803-4a93-80a8-7b41aed54742 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:09.066799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:09.067801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:09.068123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:09.068539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:09.069397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:09.071206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:09.083482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:09.084820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:09.085884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 644/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:27:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:27:09.091221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:09.187889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80021b8e-e8f1-4885-8ccc-94cf9ce9681b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:09.225736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:09.226388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:09.226670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:09.226948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:09.227655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:09.227964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:09.229357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b39-49bc-4eea-b1d2-17468cffc8ae None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:09.234370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 647/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 16 20:27:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:27:09.241124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:09.348187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c4851-8457-4f5f-9fdc-d1e526b4333b None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:09.382424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:09.383067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:09.383345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:09.383627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] PATH_INFO: `/v3/services` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:09.384322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] RBAC: Adding query filter params (type=placement) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:09.384654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:09.386016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f876b-a9d5-4589-b7c5-023896fe6a7c None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:09.390533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 645/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 16 20:27:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:11.578595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de032a63-f278-49a6-a5dc-93a2378dbc6b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.579468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de032a63-f278-49a6-a5dc-93a2378dbc6b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.579468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de032a63-f278-49a6-a5dc-93a2378dbc6b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.581688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 648/1293] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:11.590302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175baa71-3d2d-40c1-92e6-80a3caad5b25 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.590716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175baa71-3d2d-40c1-92e6-80a3caad5b25 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.590920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175baa71-3d2d-40c1-92e6-80a3caad5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.614342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-175baa71-3d2d-40c1-92e6-80a3caad5b25 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:11.615541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-175baa71-3d2d-40c1-92e6-80a3caad5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:11.687128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 646/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:27:11.709573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de032a63-f278-49a6-a5dc-93a2378dbc6b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:11.836874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de032a63-f278-49a6-a5dc-93a2378dbc6b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:11.870855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:11.871508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.871788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.872062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.872884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:11.874265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866d7eb-5040-4cff-a0c3-d8779107ee06 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:11.890086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 649/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 16 20:27:11 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:14.101747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f933-3134-4f93-a5d4-5583526b45ed None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.102592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f933-3134-4f93-a5d4-5583526b45ed None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.102592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f933-3134-4f93-a5d4-5583526b45ed None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.104755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 647/1296] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:14.111144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.111595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.112047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.132028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:14.133222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:14.203975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 650/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:27:14.230492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f933-3134-4f93-a5d4-5583526b45ed None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:14.333178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f933-3134-4f93-a5d4-5583526b45ed None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:14.367063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:14.367787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.368068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.368342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.369093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:14.370510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:14.382320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:14.383479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:14.384594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:14.388373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 648/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:27:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:14.390007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:14.510308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cdb36-cd64-4a09-92b2-e94552680b47 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:14.543652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:14.544303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.544606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.544884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.545594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:14.545902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:14.547266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:14.552454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 651/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 16 20:27:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:14.558605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:14.667358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd18f-24e6-461d-8587-e44948275e4d None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:14.700960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:14.701608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.701890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.702166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.702958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] RBAC: Adding query filter params (interface=public, service_id=999a5416bc8b424dbfa2e08d4d384dce, region_id=RegionOne) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:14.703269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:14.704659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d6802-ad17-4ce6-83ff-8c114d9413f3 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:14.709712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 649/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 16 20:27:14 2022] GET /identity/v3/endpoints?service_id=999a5416bc8b424dbfa2e08d4d384dce&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:27:14.716511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:14.824810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff11a-4977-47eb-bd02-ac38adb6a7fd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:14.858259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:14.858912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:14.859192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:14.859469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:14.860146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:14.861553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9a75b-10ae-445b-8c8c-d4a40b102c24 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:14.868776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 652/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 16 20:27:14 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:17.044383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbfe8c-c9e7-47e7-b43f-66c1c98eeb8f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.045255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbfe8c-c9e7-47e7-b43f-66c1c98eeb8f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.045255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbfe8c-c9e7-47e7-b43f-66c1c98eeb8f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.047279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 650/1302] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:27:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:17.055246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.055682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.055774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.074177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:17.075345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.145470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 653/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:27:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:27:17.167935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbfe8c-c9e7-47e7-b43f-66c1c98eeb8f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.274998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbfe8c-c9e7-47e7-b43f-66c1c98eeb8f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:17.310764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:17.311480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.311756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.312028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.312680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:17.314121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:27:17.326165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:27:17.327306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application with Lock( May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self._enter() May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application return self.creator() May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application created_value = creator( May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: ERROR keystone.server.flask.application May 16 20:27:17.328176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 651/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 16 20:27:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:27:17.333800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.447606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728323-52fb-4637-83ce-8d5b74f67f8f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:17.481846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:17.482507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.482784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.483063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.483773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:17.484074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:17.485475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d80c8f-4a18-4737-878c-7edb4e35dcf8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:17.491040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 654/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 16 20:27:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:17.497148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.600544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fba57-0f8f-4715-b3da-3cd1f1dfc558 None admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:17.639048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:17.640007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.640391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.640735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.641907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:17.644085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4273c4-1dfb-48da-bd33-eabfb63fc27f None admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:17.672961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 652/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 16 20:27:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:28:21.380085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3d3d5-f938-4b91-a0ee-aa50fb37cfb0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:21.381246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3d3d5-f938-4b91-a0ee-aa50fb37cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:21.381730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3d3d5-f938-4b91-a0ee-aa50fb37cfb0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:21.388909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b08a2-a513-4ade-b3f9-785e5008a306 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:21.389789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b08a2-a513-4ade-b3f9-785e5008a306 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:21.390293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b08a2-a513-4ade-b3f9-785e5008a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:21.393908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 655/1307] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:21.466923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-785b08a2-a513-4ade-b3f9-785e5008a306 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:21.468535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-785b08a2-a513-4ade-b3f9-785e5008a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:21.584930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 653/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:28:21.628295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:21.628969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:21.629456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:21.631074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 656/1309] 10.222.0.49 () {54 vars in 964 bytes} [Mon May 16 20:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:21.637963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e9dc-6b70-44fc-a99c-64b7e3a5a998 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:21.638254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e9dc-6b70-44fc-a99c-64b7e3a5a998 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:21.638537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e9dc-6b70-44fc-a99c-64b7e3a5a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:21.774823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3441e9dc-6b70-44fc-a99c-64b7e3a5a998 None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:21.776195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3441e9dc-6b70-44fc-a99c-64b7e3a5a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:21.883684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 654/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Mon May 16 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:21.893503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:21.895205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:22.100072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6f6f7-9fa4-4400-a800-94ab27fe80f4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:22.192993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:22.193690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:22.193973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:22.194251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:22.196159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:22.315772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:22.317259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701423-5e60-4cff-ad9f-c27b6fd22cb4 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:22.337002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 657/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:24.867509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f09dc-749a-41e8-b400-e2109f0a1a42 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:24.868375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f09dc-749a-41e8-b400-e2109f0a1a42 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:24.868688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f09dc-749a-41e8-b400-e2109f0a1a42 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:24.870079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 655/1312] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:24.875687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2067-7c21-4e36-9e18-9b40b6882e86 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:24.876121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2067-7c21-4e36-9e18-9b40b6882e86 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:24.876311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2067-7c21-4e36-9e18-9b40b6882e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:24.965140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-99ed2067-7c21-4e36-9e18-9b40b6882e86 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:24.966383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-99ed2067-7c21-4e36-9e18-9b40b6882e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:25.061784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 658/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:25.115130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:25.115393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:25.115694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:25.117117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 656/1314] 10.222.0.49 () {54 vars in 964 bytes} [Mon May 16 20:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:25.123216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8afc2-d145-4e0f-a525-effa238eb6e7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:25.123499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8afc2-d145-4e0f-a525-effa238eb6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:25.123777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8afc2-d145-4e0f-a525-effa238eb6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:25.200646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f7b8afc2-d145-4e0f-a525-effa238eb6e7 None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:25.201792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f7b8afc2-d145-4e0f-a525-effa238eb6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:25.279771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 659/1315] 10.222.0.49 () {58 vars in 1061 bytes} [Mon May 16 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:25.289049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:25.290616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:25.395280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67d96-fb1e-4fdf-92db-940f09fd7357 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:25.468320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:25.468913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:25.469189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:25.469461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:25.471129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:25.582562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:25.584028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eccf75-65be-49f6-a171-c63b37967254 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:25.603816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 657/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:28.338722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ff755-3b99-4f92-a849-309518267c81 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:28.339709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ff755-3b99-4f92-a849-309518267c81 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:28.339709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ff755-3b99-4f92-a849-309518267c81 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:28.341894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 660/1317] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:28.350633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6acc2-56df-4793-a589-fb3d74286f33 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:28.351067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6acc2-56df-4793-a589-fb3d74286f33 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:28.351193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6acc2-56df-4793-a589-fb3d74286f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:28.432731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-32e6acc2-56df-4793-a589-fb3d74286f33 None None] MFA Rules not processed for user `05a40660aa4e49c19e3672f6cd646096`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:28.434498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-32e6acc2-56df-4793-a589-fb3d74286f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:28.553330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 658/1318] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:28.598812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ff755-3b99-4f92-a849-309518267c81 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:28.600430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-582ff755-3b99-4f92-a849-309518267c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:28.712402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ff755-3b99-4f92-a849-309518267c81 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:28.784904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:28.785539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:28.785816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:28.786086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:28.787783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:28.901196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:28.902629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0cc76-d66b-4151-9937-695672fa1578 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:28.921008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 661/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:31.653696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:31.654275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:31.654275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:31.655613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 659/1320] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:31.662274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135b43-7db1-44bc-a06b-8bf666c53003 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:31.662730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135b43-7db1-44bc-a06b-8bf666c53003 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:31.662876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135b43-7db1-44bc-a06b-8bf666c53003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:31.741470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5d135b43-7db1-44bc-a06b-8bf666c53003 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:31.742678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5d135b43-7db1-44bc-a06b-8bf666c53003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:31.847756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 662/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:31.889242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:31.891758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:31.998232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada902f9-fdd1-4ada-a8e4-0414fa654765 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:32.085923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:32.086574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:32.086854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:32.087127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:32.088805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:32.203984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:32.205462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20cd3c-06b3-4be7-a29d-2cfa797a406f service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:32.224057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 660/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:35.324192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:35.324829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:35.324829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:35.326151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 663/1323] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:35.331483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ec81-c4b2-4623-b9c0-1244536044b3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:35.331917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ec81-c4b2-4623-b9c0-1244536044b3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:35.332007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ec81-c4b2-4623-b9c0-1244536044b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:35.395457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5453ec81-c4b2-4623-b9c0-1244536044b3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:35.396678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5453ec81-c4b2-4623-b9c0-1244536044b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:35.492163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 661/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:35.527304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:35.528886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:35.634039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26401c0-264d-497e-8490-d92e7d2bac4a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:35.708585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:35.709242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:35.709523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:35.709800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:35.711445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:35.823213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:35.824708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756946f-874e-4534-a7fe-66208cd84f99 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:35.845544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 664/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:28:38.104187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:38.104791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:38.104791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:38.106029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 662/1326] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:38.111768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211610d-80da-40d8-9934-2b733356f637 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:38.112171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211610d-80da-40d8-9934-2b733356f637 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:38.112321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211610d-80da-40d8-9934-2b733356f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:38.176457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d211610d-80da-40d8-9934-2b733356f637 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:38.177784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d211610d-80da-40d8-9934-2b733356f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:38.275241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 665/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:38.310238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:38.311858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:38.417209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ef4be-183d-4fc7-829b-8a8f3591ec4f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:38.489721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:38.490370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:38.490653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:38.490929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:38.492604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:38.601561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:38.603014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abdc33-0d60-4017-a1f2-ae216d282063 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:38.622386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 663/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:40.869738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:40.870323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:40.870323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:40.871648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 666/1329] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:40.877224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501b73-8631-4d62-a7dc-8806d2d3b110 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:40.877669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501b73-8631-4d62-a7dc-8806d2d3b110 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:40.877766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41501b73-8631-4d62-a7dc-8806d2d3b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:40.942637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-41501b73-8631-4d62-a7dc-8806d2d3b110 None None] MFA Rules not processed for user `05a40660aa4e49c19e3672f6cd646096`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:40.943750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-41501b73-8631-4d62-a7dc-8806d2d3b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:41.044147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 664/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:41.081641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:41.083348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:41.187959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be72c3-9946-478f-98d9-e1edb0bd4861 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:41.260913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:41.261479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:41.261756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:41.262030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:41.263656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:41.370688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:41.372135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573afdc0-13fd-41b6-98cb-7ae6f13e449f service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:41.390321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 667/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:43.836231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:43.836809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:43.836809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:43.838189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 665/1332] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:43.844250 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f8872-2bc0-47d0-ac2c-1a3ccda9ac2f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:43.844731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f8872-2bc0-47d0-ac2c-1a3ccda9ac2f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:43.844855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f8872-2bc0-47d0-ac2c-1a3ccda9ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:43.919165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bd0f8872-2bc0-47d0-ac2c-1a3ccda9ac2f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:43.920934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bd0f8872-2bc0-47d0-ac2c-1a3ccda9ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:44.027607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 668/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:44.062914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:44.064563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:44.180342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3674635-fd45-496c-9a61-5ecdd373921e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:44.258643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:44.259298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:44.259582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:44.259853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:44.261549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:44.377962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:44.379478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0893a24-3c7b-48a5-bdad-509b3eee4509 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:44.398105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 666/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:46.634705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:46.635283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:46.635283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:46.636767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 669/1335] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:46.645004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93f10-fb6c-41e6-a7b0-9c6a6498a1e4 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:46.645460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93f10-fb6c-41e6-a7b0-9c6a6498a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:46.645643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93f10-fb6c-41e6-a7b0-9c6a6498a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:46.729574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-74e93f10-fb6c-41e6-a7b0-9c6a6498a1e4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:46.731911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-74e93f10-fb6c-41e6-a7b0-9c6a6498a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:46.848646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 667/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:46.899971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:46.901538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:47.012393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f1b2-b5d9-4200-a669-5a51602ba490 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:47.085221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:47.085867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:47.086146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:47.086416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:47.088044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:47.197949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:47.199391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92112e4-2c4d-44cb-83de-91727511e987 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:47.218480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 670/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:28:49.753106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:49.753978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:49.753978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:49.756258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 668/1338] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:49.762586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dded7-411e-42d0-8420-c8c97ff2a8aa None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:49.763049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dded7-411e-42d0-8420-c8c97ff2a8aa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:49.763157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dded7-411e-42d0-8420-c8c97ff2a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:49.833930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-541dded7-411e-42d0-8420-c8c97ff2a8aa None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:49.835125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-541dded7-411e-42d0-8420-c8c97ff2a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:49.929594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 671/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:49.977552 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:49.979530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:50.085393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66e001-9897-4a35-8065-abfeabaa4b47 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:50.170264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:50.171251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:50.171710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:50.172168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:50.174878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:50.298430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:50.299900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755736f-5c19-44fc-87b5-c89ec2ffe6bf service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:50.319067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 669/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:54.676732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610617a-e3d1-484d-a468-2033484de152 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:54.677526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610617a-e3d1-484d-a468-2033484de152 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:54.677526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610617a-e3d1-484d-a468-2033484de152 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:54.678915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 672/1341] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:54.684590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021923d3-fa45-47f1-b0be-2f09b8ad92b0 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:54.684991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021923d3-fa45-47f1-b0be-2f09b8ad92b0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:54.685165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021923d3-fa45-47f1-b0be-2f09b8ad92b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:54.755376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-021923d3-fa45-47f1-b0be-2f09b8ad92b0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:54.756581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-021923d3-fa45-47f1-b0be-2f09b8ad92b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:54.863446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 670/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:54.901111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610617a-e3d1-484d-a468-2033484de152 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:54.903413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9610617a-e3d1-484d-a468-2033484de152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:54.999244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610617a-e3d1-484d-a468-2033484de152 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:55.002775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:55.003431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:55.003702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:55.003980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:55.015506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:55.017003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c62900-f139-42c6-9f8f-dfa594d5f5de service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:55.026373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 673/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:57.808394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:57.808972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:57.808972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:57.810243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 671/1344] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:28:57.815723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3739-ddc7-4299-9d68-af1ffd0017de None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:57.816155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3739-ddc7-4299-9d68-af1ffd0017de None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:57.816300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3739-ddc7-4299-9d68-af1ffd0017de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:57.846070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cf0d3739-ddc7-4299-9d68-af1ffd0017de None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:57.847289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cf0d3739-ddc7-4299-9d68-af1ffd0017de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:57.925266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 674/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:57.961379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:57.963286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:57.977043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a51bb-7964-4f0a-ac1f-2b3a931bea41 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:57.981658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:57.982384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:57.982733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:57.983073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:57.993212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:57.994664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57b2a-1057-4b06-99f5-41e890ceb416 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:58.004187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 672/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:02.380603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a510-e23f-478f-8322-83b9c95bda9b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:02.381181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a510-e23f-478f-8322-83b9c95bda9b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:02.381181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a510-e23f-478f-8322-83b9c95bda9b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:02.382762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 675/1347] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:02.390181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63424-89ac-41fa-b117-2904c3f02b2a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:02.390637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63424-89ac-41fa-b117-2904c3f02b2a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:02.390862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63424-89ac-41fa-b117-2904c3f02b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:02.410293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bce63424-89ac-41fa-b117-2904c3f02b2a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:02.411412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bce63424-89ac-41fa-b117-2904c3f02b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:02.420307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 673/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:02.457519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a510-e23f-478f-8322-83b9c95bda9b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:02.468997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a510-e23f-478f-8322-83b9c95bda9b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:02.472855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:02.473483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:02.473755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:02.474024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:02.483412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:02.484866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a989-b1fa-4c93-8997-565fdd537262 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:02.494048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 676/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:07.671188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69884-47a3-4469-8a6c-cec11b30ec87 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:07.671699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69884-47a3-4469-8a6c-cec11b30ec87 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:07.671786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69884-47a3-4469-8a6c-cec11b30ec87 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:07.673196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 674/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:07.689998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eebae-fca4-4238-84ad-d21beff7066b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:07.690942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eebae-fca4-4238-84ad-d21beff7066b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:07.691397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eebae-fca4-4238-84ad-d21beff7066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:07.789013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a22eebae-fca4-4238-84ad-d21beff7066b None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:07.790452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a22eebae-fca4-4238-84ad-d21beff7066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:07.870666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 677/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:29:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:11.979835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15930834-b2bb-4362-9675-3cc7f53cd027 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:11.980766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15930834-b2bb-4362-9675-3cc7f53cd027 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:11.981002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15930834-b2bb-4362-9675-3cc7f53cd027 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:11.982554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 675/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:11.988914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21c80-5b9c-4463-a6ce-6bf6e02e04f7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:11.989375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21c80-5b9c-4463-a6ce-6bf6e02e04f7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:11.989455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21c80-5b9c-4463-a6ce-6bf6e02e04f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:12.008144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f8a21c80-5b9c-4463-a6ce-6bf6e02e04f7 None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:12.009434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f8a21c80-5b9c-4463-a6ce-6bf6e02e04f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:12.018748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 678/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:13.697948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce9df-5145-4b5e-8757-22a7c28e7d38 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:13.698490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce9df-5145-4b5e-8757-22a7c28e7d38 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:13.698490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce9df-5145-4b5e-8757-22a7c28e7d38 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:13.699790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 676/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:13.704792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab3b9-3b6c-4d0e-aaa8-a87659cef825 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:13.705254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab3b9-3b6c-4d0e-aaa8-a87659cef825 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:13.705501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab3b9-3b6c-4d0e-aaa8-a87659cef825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:13.723748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-35cab3b9-3b6c-4d0e-aaa8-a87659cef825 None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:13.724967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-35cab3b9-3b6c-4d0e-aaa8-a87659cef825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:13.734272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 679/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:29:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:17.592956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1626cb-baed-4a6a-9a8b-cbc9fa339979 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:17.593514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1626cb-baed-4a6a-9a8b-cbc9fa339979 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:17.593514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1626cb-baed-4a6a-9a8b-cbc9fa339979 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:17.595085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 677/1356] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:17.602139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f2831-8e0e-4b7a-8902-22edd40aa164 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:17.604009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f2831-8e0e-4b7a-8902-22edd40aa164 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:17.604567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f2831-8e0e-4b7a-8902-22edd40aa164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:17.626304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d55f2831-8e0e-4b7a-8902-22edd40aa164 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:17.628381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d55f2831-8e0e-4b7a-8902-22edd40aa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:17.637230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 680/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:17.687917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b3b8-7e15-4216-befd-c4a2d2f63cb1 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:17.688205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b3b8-7e15-4216-befd-c4a2d2f63cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:17.688682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b3b8-7e15-4216-befd-c4a2d2f63cb1 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:17.690152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 678/1358] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 16 20:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:17.696220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393edc-256f-4794-b3be-8bc04d860ab1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:17.696558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393edc-256f-4794-b3be-8bc04d860ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:17.697068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393edc-256f-4794-b3be-8bc04d860ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:17.745246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9c393edc-256f-4794-b3be-8bc04d860ab1 None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:17.746555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9c393edc-256f-4794-b3be-8bc04d860ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:17.828942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 681/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 16 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:17.837481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b3b8-7e15-4216-befd-c4a2d2f63cb1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:17.852978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b3b8-7e15-4216-befd-c4a2d2f63cb1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:17.859380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:17.860021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:17.860306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:17.860699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:17.869419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:17.871028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ea86-678d-4d5e-b6aa-f695dfa10e4c service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:17.880477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 679/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:20.303634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6ea7-6a5e-4c29-81fe-367c2037930b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:20.304245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6ea7-6a5e-4c29-81fe-367c2037930b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:20.304245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6ea7-6a5e-4c29-81fe-367c2037930b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:20.305796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 682/1361] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:20.310898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829f6c-3ea6-4cee-b508-dcde83e801d2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:20.311351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829f6c-3ea6-4cee-b508-dcde83e801d2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:20.311445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829f6c-3ea6-4cee-b508-dcde83e801d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:20.329435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6b829f6c-3ea6-4cee-b508-dcde83e801d2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:20.330661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6b829f6c-3ea6-4cee-b508-dcde83e801d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:20.338953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 680/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:20.383548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe6ea7-6a5e-4c29-81fe-367c2037930b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:20.399649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe6ea7-6a5e-4c29-81fe-367c2037930b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:20.405609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:20.406392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:20.406775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:20.407154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:20.415862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:20.417605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ece13a-d4c8-473e-bec2-1267d83211ff service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:20.427809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 683/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:22.941720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399bd0-9080-43c2-9596-f86a604aba87 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:22.942279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399bd0-9080-43c2-9596-f86a604aba87 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:22.942279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399bd0-9080-43c2-9596-f86a604aba87 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:22.943591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 681/1364] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:22.949147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a0a2-a3a0-4045-938a-da8c8845db2b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:22.949604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a0a2-a3a0-4045-938a-da8c8845db2b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:22.949698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a0a2-a3a0-4045-938a-da8c8845db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:22.977409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e087a0a2-a3a0-4045-938a-da8c8845db2b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:22.978985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e087a0a2-a3a0-4045-938a-da8c8845db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:22.987924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 684/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:23.037438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c73f5-f907-4ae8-9af5-cc378c04ae0e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:23.037717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c73f5-f907-4ae8-9af5-cc378c04ae0e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:23.037984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c73f5-f907-4ae8-9af5-cc378c04ae0e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:23.039342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 682/1366] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 16 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:23.045409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5523f-974c-4a03-bb08-27d52ba41ecf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:23.045927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5523f-974c-4a03-bb08-27d52ba41ecf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:23.046400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5523f-974c-4a03-bb08-27d52ba41ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:23.067964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5eb5523f-974c-4a03-bb08-27d52ba41ecf None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:23.069973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5eb5523f-974c-4a03-bb08-27d52ba41ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:23.086976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 685/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 16 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:23.098167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c73f5-f907-4ae8-9af5-cc378c04ae0e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:23.112825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c73f5-f907-4ae8-9af5-cc378c04ae0e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:23.118062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:23.118694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:23.118971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:23.119295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:23.127819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:23.129428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff041b-4e1a-4f4e-bb99-8a7cf157a8ba service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:23.138395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 683/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:25.429661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc62a-360e-4899-b4b2-b55baf29c0d4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:25.430259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc62a-360e-4899-b4b2-b55baf29c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:25.430259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc62a-360e-4899-b4b2-b55baf29c0d4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:25.431728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 686/1369] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:25.437259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb459a-1c18-4b24-aee6-61e92c89ff43 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:25.437734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb459a-1c18-4b24-aee6-61e92c89ff43 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:25.437818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb459a-1c18-4b24-aee6-61e92c89ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:25.458300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f1bb459a-1c18-4b24-aee6-61e92c89ff43 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:25.459490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1bb459a-1c18-4b24-aee6-61e92c89ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:25.468391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 684/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:25.512388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc62a-360e-4899-b4b2-b55baf29c0d4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:25.527142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc62a-360e-4899-b4b2-b55baf29c0d4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:25.532881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:25.533621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:25.533987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:25.534330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:25.542930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:25.544632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176125e-fe4c-4cd7-8b21-a9f71b34cff1 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:25.554129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 687/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:25.808323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c650c-c746-4c23-8308-9b31c172504d None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:25.808753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c650c-c746-4c23-8308-9b31c172504d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:25.808753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c650c-c746-4c23-8308-9b31c172504d None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:25.810505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 685/1372] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:25.816647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a2e0-46d5-4b7c-b253-2fdd8aea908e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:25.816914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a2e0-46d5-4b7c-b253-2fdd8aea908e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:25.817444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a2e0-46d5-4b7c-b253-2fdd8aea908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:25.836840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d759a2e0-46d5-4b7c-b253-2fdd8aea908e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:25.838021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d759a2e0-46d5-4b7c-b253-2fdd8aea908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:25.847270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 688/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:26.160341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964762d-a279-41dd-8689-b342c73f7307 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:26.160341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964762d-a279-41dd-8689-b342c73f7307 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:26.160341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964762d-a279-41dd-8689-b342c73f7307 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:26.163275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 686/1374] 10.222.0.49 () {54 vars in 963 bytes} [Mon May 16 20:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:26.167717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e795-c8f8-4bc1-885b-14f2cc9dfff7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:26.167992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e795-c8f8-4bc1-885b-14f2cc9dfff7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:26.168294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e795-c8f8-4bc1-885b-14f2cc9dfff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:26.218737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0104e795-c8f8-4bc1-885b-14f2cc9dfff7 None None] MFA Rules not processed for user `d46868d054b34480935d579ea9b22171`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:26.220122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0104e795-c8f8-4bc1-885b-14f2cc9dfff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:26.281277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 689/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Mon May 16 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:26.289094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964762d-a279-41dd-8689-b342c73f7307 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:26.300179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964762d-a279-41dd-8689-b342c73f7307 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:26.303895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:26.304656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:26.305090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:26.305618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:26.315110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:26.316845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ad775-74d5-40f2-b944-61e2430a67bf service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:26.326514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 687/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:27.842310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb23-6b4b-47fa-80bf-6b8632c2381c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:27.842899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb23-6b4b-47fa-80bf-6b8632c2381c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:27.842899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6bb23-6b4b-47fa-80bf-6b8632c2381c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:27.844469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 690/1377] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:27.851068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64b3d-7d67-41b7-bf0f-67afd9c3fdeb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:27.851649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64b3d-7d67-41b7-bf0f-67afd9c3fdeb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:27.851649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64b3d-7d67-41b7-bf0f-67afd9c3fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:27.871265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3aa64b3d-7d67-41b7-bf0f-67afd9c3fdeb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:27.872551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3aa64b3d-7d67-41b7-bf0f-67afd9c3fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:27.882086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 688/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:27.926570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6bb23-6b4b-47fa-80bf-6b8632c2381c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:27.943344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6bb23-6b4b-47fa-80bf-6b8632c2381c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:27.949468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:27.950301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:27.950585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:27.950859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:27.960310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:27.961985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917dd6-8d22-4054-b3f1-f9dd1378e491 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:27.972626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 691/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:30.212194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b09f-c7b2-47a5-bbfc-94b6935d43c5 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:30.212845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b09f-c7b2-47a5-bbfc-94b6935d43c5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:30.212845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924b09f-c7b2-47a5-bbfc-94b6935d43c5 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:30.214135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 689/1380] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:30.219601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb258-8e7d-4f38-b727-fc4546afe3e7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:30.220547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb258-8e7d-4f38-b727-fc4546afe3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:30.220787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb258-8e7d-4f38-b727-fc4546afe3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:30.239509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-16fbb258-8e7d-4f38-b727-fc4546afe3e7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:30.241191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-16fbb258-8e7d-4f38-b727-fc4546afe3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:30.249488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 692/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:30.293401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924b09f-c7b2-47a5-bbfc-94b6935d43c5 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:30.309158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924b09f-c7b2-47a5-bbfc-94b6935d43c5 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:30.315261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:30.316065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:30.316431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:30.316828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:30.325457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:30.327155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca992d-acef-4b1f-8886-ad48ff91b8d0 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:30.336538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 690/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:32.569024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2a546-3634-4f46-afea-09ff35cc5cc0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:32.569571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2a546-3634-4f46-afea-09ff35cc5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:32.569571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2a546-3634-4f46-afea-09ff35cc5cc0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:32.570811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 693/1383] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:32.576180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3aaff-57ba-46dd-8f24-8edd3a77da07 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:32.576640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3aaff-57ba-46dd-8f24-8edd3a77da07 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:32.576740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3aaff-57ba-46dd-8f24-8edd3a77da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:32.594465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-71f3aaff-57ba-46dd-8f24-8edd3a77da07 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:32.595684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-71f3aaff-57ba-46dd-8f24-8edd3a77da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:32.606187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 691/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:32.649343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2a546-3634-4f46-afea-09ff35cc5cc0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:32.670749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2a546-3634-4f46-afea-09ff35cc5cc0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:32.678066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:32.679155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:32.679659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:32.680143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:32.691029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:32.693134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52664101-28e3-485e-80f8-9f37a66ed441 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:32.705140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 694/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:34.936263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7c08-c65a-4619-8a35-b57cf336d203 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:34.937016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7c08-c65a-4619-8a35-b57cf336d203 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:34.937016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7c08-c65a-4619-8a35-b57cf336d203 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:34.938276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 692/1386] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:34.946156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcdd30-cfe2-4edd-9799-568a70b8bb60 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:34.946701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcdd30-cfe2-4edd-9799-568a70b8bb60 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:34.947006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcdd30-cfe2-4edd-9799-568a70b8bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:34.971884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b1bcdd30-cfe2-4edd-9799-568a70b8bb60 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:34.974039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b1bcdd30-cfe2-4edd-9799-568a70b8bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:34.985801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 695/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:35.046300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7c08-c65a-4619-8a35-b57cf336d203 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:35.061357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7c08-c65a-4619-8a35-b57cf336d203 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:35.067068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:35.067704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:35.068017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:35.068284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:35.077160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:35.078939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855371a-742c-46a7-b0d0-1d78cf2982ed service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:35.089048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 693/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:37.491842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71f18-5758-4831-87e2-3bcaf062b322 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:37.492458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71f18-5758-4831-87e2-3bcaf062b322 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:37.492458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71f18-5758-4831-87e2-3bcaf062b322 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:37.493919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 696/1389] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:37.499765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64240-0d10-46c6-ae5b-846967cd673c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:37.500394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64240-0d10-46c6-ae5b-846967cd673c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:37.500394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64240-0d10-46c6-ae5b-846967cd673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:37.519684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e1b64240-0d10-46c6-ae5b-846967cd673c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:37.521302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e1b64240-0d10-46c6-ae5b-846967cd673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:37.530480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 694/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:37.577774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb71f18-5758-4831-87e2-3bcaf062b322 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:37.593500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb71f18-5758-4831-87e2-3bcaf062b322 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:37.600202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:37.601019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:37.601345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:37.601572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:37.611527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:37.613283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73c32e-b8b9-4377-8608-5e80fab7bd39 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:37.623139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 697/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:29:40.073984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a20f-e195-4162-9fcd-7e082c13c48b None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:40.074676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a20f-e195-4162-9fcd-7e082c13c48b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:40.074676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a20f-e195-4162-9fcd-7e082c13c48b None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:40.075891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 695/1392] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:40.081559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec246-29c6-4e04-8451-29ea6c2b8a8f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:40.082032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec246-29c6-4e04-8451-29ea6c2b8a8f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:40.082137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec246-29c6-4e04-8451-29ea6c2b8a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:40.101202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f87ec246-29c6-4e04-8451-29ea6c2b8a8f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:40.102778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f87ec246-29c6-4e04-8451-29ea6c2b8a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:40.111961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 698/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:40.155616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745a20f-e195-4162-9fcd-7e082c13c48b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:40.169681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745a20f-e195-4162-9fcd-7e082c13c48b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:40.175421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:40.176090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:40.176373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:40.176669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:40.185024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:40.186587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00397a4a-c915-493e-a126-a301a9aea9b2 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:40.195963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 696/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:41.831399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106dd18-2ee8-46bc-a4e5-e5e471a2872c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:41.831941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106dd18-2ee8-46bc-a4e5-e5e471a2872c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:41.831941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106dd18-2ee8-46bc-a4e5-e5e471a2872c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:41.833342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 699/1395] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:41.838749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd5b0-81bb-4964-a2a8-250ca93d3072 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:41.839221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd5b0-81bb-4964-a2a8-250ca93d3072 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:41.839346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd5b0-81bb-4964-a2a8-250ca93d3072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:41.857642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-fd6fd5b0-81bb-4964-a2a8-250ca93d3072 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:41.858826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fd6fd5b0-81bb-4964-a2a8-250ca93d3072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:41.867263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 697/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:41.922554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb55fa-8950-4612-96a1-3deee871dddf None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:41.922846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb55fa-8950-4612-96a1-3deee871dddf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:41.923128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb55fa-8950-4612-96a1-3deee871dddf None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:41.924543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 700/1397] 10.222.0.49 () {54 vars in 962 bytes} [Mon May 16 20:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:41.929752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccab51-ea4b-4af4-9a41-bdb899958a33 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:41.930041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccab51-ea4b-4af4-9a41-bdb899958a33 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:41.930312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccab51-ea4b-4af4-9a41-bdb899958a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:41.985829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-70ccab51-ea4b-4af4-9a41-bdb899958a33 None None] MFA Rules not processed for user `ec2c313f5a654d159c98a2f88b8f4d55`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:41.987044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-70ccab51-ea4b-4af4-9a41-bdb899958a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:42.048354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 698/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Mon May 16 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:42.056240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb55fa-8950-4612-96a1-3deee871dddf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:42.068089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb55fa-8950-4612-96a1-3deee871dddf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:42.072060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:42.072763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.073038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.073309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.083229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:42.084722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c0e56-abbd-4a3f-aabc-7fb78fd1b64d service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:42.094305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 701/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:42.424484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339abd2-de7a-4cf2-a4a5-92adadced7f4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.424775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339abd2-de7a-4cf2-a4a5-92adadced7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.425069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339abd2-de7a-4cf2-a4a5-92adadced7f4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.426546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 699/1400] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:42.433030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8275-366c-41b9-8b29-57a412d23562 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.433347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8275-366c-41b9-8b29-57a412d23562 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.433630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8275-366c-41b9-8b29-57a412d23562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.452586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0e3f8275-366c-41b9-8b29-57a412d23562 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:42.453943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0e3f8275-366c-41b9-8b29-57a412d23562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:42.462802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 702/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:42.506468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339abd2-de7a-4cf2-a4a5-92adadced7f4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:42.520255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76060-19cc-449d-883c-82cd56f9235f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.520579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76060-19cc-449d-883c-82cd56f9235f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.520696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339abd2-de7a-4cf2-a4a5-92adadced7f4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:42.520894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76060-19cc-449d-883c-82cd56f9235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.525996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:42.526634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.526915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.527185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.535327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:42.536944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340bb9-df64-4d04-9f9b-5545ec476607 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:42.546084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 700/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:29:42.570913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-96c76060-19cc-449d-883c-82cd56f9235f None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:42.572164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-96c76060-19cc-449d-883c-82cd56f9235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:42.641232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 703/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:42.690867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb720f-e430-41af-b665-3b5c29e0e474 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.691158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb720f-e430-41af-b665-3b5c29e0e474 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.691446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb720f-e430-41af-b665-3b5c29e0e474 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.692880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 942 bytes} [Mon May 16 20:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:42.700009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb794d-91d2-4ec1-ad1f-fbf1e19fdf12 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.700278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb794d-91d2-4ec1-ad1f-fbf1e19fdf12 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.700621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb794d-91d2-4ec1-ad1f-fbf1e19fdf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.755372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-11cb794d-91d2-4ec1-ad1f-fbf1e19fdf12 None None] MFA Rules not processed for user `839acae1c8eb4ff29260410a01f2ced6`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:42.756663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-11cb794d-91d2-4ec1-ad1f-fbf1e19fdf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:42.829538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Mon May 16 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:42.838912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb720f-e430-41af-b665-3b5c29e0e474 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:42.852860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb720f-e430-41af-b665-3b5c29e0e474 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:42.857840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:42.858475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:42.858752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:42.859022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:42.867206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:42.868789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf1b0-04ea-4f97-a11e-4744a306f513 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:42.876921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:29:44.814890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7ffd-b378-47b1-aaf4-da222fc22515 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:44.814890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7ffd-b378-47b1-aaf4-da222fc22515 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:44.814890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7ffd-b378-47b1-aaf4-da222fc22515 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:44.814890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:29:44.822049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909a6f-a821-4b7b-b5ef-3428761117ee None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:44.822592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909a6f-a821-4b7b-b5ef-3428761117ee None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:44.824809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909a6f-a821-4b7b-b5ef-3428761117ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:44.849784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bf909a6f-a821-4b7b-b5ef-3428761117ee None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:44.851576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bf909a6f-a821-4b7b-b5ef-3428761117ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:44.865641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:44.915585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7ffd-b378-47b1-aaf4-da222fc22515 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:29:44.947070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7ffd-b378-47b1-aaf4-da222fc22515 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:29:44.954129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:29:44.954982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:44.955420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:44.959872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:44.968549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:29:44.970549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa87cb1-9485-4eb5-8d6b-cf3e086abdb1 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:29:44.980494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:05.958363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec7b-1646-4d40-b47b-113c04bd9bf6 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:05.959025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec7b-1646-4d40-b47b-113c04bd9bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:05.959025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ec7b-1646-4d40-b47b-113c04bd9bf6 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:05.961317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon May 16 20:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:05.967771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c312d-bc93-4e31-b8da-5c4fe988fccc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:05.968246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c312d-bc93-4e31-b8da-5c4fe988fccc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:05.968364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c312d-bc93-4e31-b8da-5c4fe988fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:05.992083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-661c312d-bc93-4e31-b8da-5c4fe988fccc None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:05.993327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-661c312d-bc93-4e31-b8da-5c4fe988fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:06.002755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 16 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:06.023554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8916a-07d7-4ad8-8fbc-3a3f01fd5b4a None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:06.023925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8916a-07d7-4ad8-8fbc-3a3f01fd5b4a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:06.024274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8916a-07d7-4ad8-8fbc-3a3f01fd5b4a None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:06.026409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon May 16 20:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:06.032386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb10f-d1c7-40fc-b981-71d519f7804a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:06.032712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb10f-d1c7-40fc-b981-71d519f7804a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:06.032998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb10f-d1c7-40fc-b981-71d519f7804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:06.050992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-791eb10f-d1c7-40fc-b981-71d519f7804a None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:06.052169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-791eb10f-d1c7-40fc-b981-71d519f7804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:06.061995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 16 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:30:08.748261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6cf99-544b-4a9a-9267-bd0d51befdc8 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:08.748863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6cf99-544b-4a9a-9267-bd0d51befdc8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:08.748863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6cf99-544b-4a9a-9267-bd0d51befdc8 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:08.750218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:08.757262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceaba-7a2f-4f8e-83c0-e693536f11d9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:08.758037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceaba-7a2f-4f8e-83c0-e693536f11d9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:08.758193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceaba-7a2f-4f8e-83c0-e693536f11d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:08.778980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-86bceaba-7a2f-4f8e-83c0-e693536f11d9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:08.780165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-86bceaba-7a2f-4f8e-83c0-e693536f11d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:08.788132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:08.834013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6cf99-544b-4a9a-9267-bd0d51befdc8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:08.857082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6cf99-544b-4a9a-9267-bd0d51befdc8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:08.863087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:08.863742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:08.864027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:08.864296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:08.873896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:08.875581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7686-8787-4b6f-b052-b91248a6f6d8 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:08.885326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:09.876390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44500e7-3d75-4cec-8ab3-cdb658e6733d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:09.877289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44500e7-3d75-4cec-8ab3-cdb658e6733d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:09.877289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44500e7-3d75-4cec-8ab3-cdb658e6733d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:09.879418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:09.892181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89eb1-8320-46eb-a976-ce6357960bb7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:09.892695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89eb1-8320-46eb-a976-ce6357960bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:09.892804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89eb1-8320-46eb-a976-ce6357960bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:09.915290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b3a89eb1-8320-46eb-a976-ce6357960bb7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:09.916480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b3a89eb1-8320-46eb-a976-ce6357960bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:09.924987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:10.085173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44500e7-3d75-4cec-8ab3-cdb658e6733d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.102189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44500e7-3d75-4cec-8ab3-cdb658e6733d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.108155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.108819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.109103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.109382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.117602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.119192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8271a7-f561-4e3c-8fb0-d5a65f201d8b service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.129158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:11.075304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c421d-48b9-4a76-9876-797ea59006a3 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.076140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c421d-48b9-4a76-9876-797ea59006a3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.076140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c421d-48b9-4a76-9876-797ea59006a3 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.077526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:11.082743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b90d-4ace-4513-8691-cf213f39068e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.083201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b90d-4ace-4513-8691-cf213f39068e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.083311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b90d-4ace-4513-8691-cf213f39068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.103112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c630b90d-4ace-4513-8691-cf213f39068e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:11.104305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c630b90d-4ace-4513-8691-cf213f39068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:11.113081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:11.266807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c421d-48b9-4a76-9876-797ea59006a3 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.289042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c421d-48b9-4a76-9876-797ea59006a3 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.295721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.296361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.296680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.296956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.305322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.306928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170694-b3b9-4d82-8b96-fbe5a2d1c45b service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.317088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:12.235421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6295b-25a2-43c9-a6c3-e41f85513e5c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:12.236024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6295b-25a2-43c9-a6c3-e41f85513e5c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:12.236024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6295b-25a2-43c9-a6c3-e41f85513e5c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:12.237422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:12.242553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0cbe-5823-4a7b-981e-3f101c0bfaca None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:12.242962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0cbe-5823-4a7b-981e-3f101c0bfaca None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:12.243159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0cbe-5823-4a7b-981e-3f101c0bfaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:12.263683 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b91f0cbe-5823-4a7b-981e-3f101c0bfaca None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:12.264935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b91f0cbe-5823-4a7b-981e-3f101c0bfaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:12.273065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:12.425235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6295b-25a2-43c9-a6c3-e41f85513e5c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:12.439926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6295b-25a2-43c9-a6c3-e41f85513e5c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:12.445388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:12.446022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:12.446306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:12.446585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:12.454655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:12.456253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fde1d-2ff4-4bd0-b525-d9dae386381a service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:12.465682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:13.393460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d575fa-e9a1-46c9-b743-dcd9be04a0d4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:13.394022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d575fa-e9a1-46c9-b743-dcd9be04a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:13.394022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d575fa-e9a1-46c9-b743-dcd9be04a0d4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:13.395586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:13.400819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5c6c-5e57-4d39-8e2c-c93f6a851ba2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:13.401231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5c6c-5e57-4d39-8e2c-c93f6a851ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:13.401429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5c6c-5e57-4d39-8e2c-c93f6a851ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:13.420644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-91db5c6c-5e57-4d39-8e2c-c93f6a851ba2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:13.421823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-91db5c6c-5e57-4d39-8e2c-c93f6a851ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:13.430438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:13.577843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d575fa-e9a1-46c9-b743-dcd9be04a0d4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:13.594051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d575fa-e9a1-46c9-b743-dcd9be04a0d4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:13.601083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:13.601715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:13.601988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:13.602262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:13.610204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:13.611770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd42e-7173-422d-bd34-b7ca17a6bbe0 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:13.620509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:14.498327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7183-0ab5-4c3d-8f52-bd6c6777f3b5 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:14.498888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7183-0ab5-4c3d-8f52-bd6c6777f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:14.498888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7183-0ab5-4c3d-8f52-bd6c6777f3b5 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:14.500257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:14.505751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e78da-3363-48f8-8d82-0c2065f7569d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:14.506175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e78da-3363-48f8-8d82-0c2065f7569d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:14.506287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e78da-3363-48f8-8d82-0c2065f7569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:14.525864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-708e78da-3363-48f8-8d82-0c2065f7569d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:14.527059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-708e78da-3363-48f8-8d82-0c2065f7569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:14.535576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:14.687990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e7183-0ab5-4c3d-8f52-bd6c6777f3b5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:14.704538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e7183-0ab5-4c3d-8f52-bd6c6777f3b5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:14.710695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:14.711336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:14.711629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:14.711899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:14.720411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:14.722022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857050b9-5a3b-4175-bc29-d25ee2c9163f service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:14.731871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:15.598828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd081f3-ae88-4b71-9510-9fea63fb4eff None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.599419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd081f3-ae88-4b71-9510-9fea63fb4eff None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.599419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd081f3-ae88-4b71-9510-9fea63fb4eff None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.601158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:15.606191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b361-f58b-42c7-8387-8b994df3ac49 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.606705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b361-f58b-42c7-8387-8b994df3ac49 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.606807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b361-f58b-42c7-8387-8b994df3ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.626554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dc32b361-f58b-42c7-8387-8b994df3ac49 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:15.627755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dc32b361-f58b-42c7-8387-8b994df3ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:15.637759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:15.788034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd081f3-ae88-4b71-9510-9fea63fb4eff None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:15.803618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd081f3-ae88-4b71-9510-9fea63fb4eff None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:15.810060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:15.810697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.810973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.811243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.820082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:15.821690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac625b-feeb-4b15-9c61-5cb307a5ee67 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:15.831324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:16.715609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ee27-da9d-47b0-9c5d-ba5a9ffd0784 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.716154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ee27-da9d-47b0-9c5d-ba5a9ffd0784 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.716275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ee27-da9d-47b0-9c5d-ba5a9ffd0784 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.717712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:16.725636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608373-1d92-4836-a619-f30b6dac36a7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.726196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608373-1d92-4836-a619-f30b6dac36a7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.726196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608373-1d92-4836-a619-f30b6dac36a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.746685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8b608373-1d92-4836-a619-f30b6dac36a7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:16.747992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8b608373-1d92-4836-a619-f30b6dac36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:16.757476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:16.908211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ee27-da9d-47b0-9c5d-ba5a9ffd0784 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.928178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ee27-da9d-47b0-9c5d-ba5a9ffd0784 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.934683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.935314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.935592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.935864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.944102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.945756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0eb6b-150a-4a0d-a3e8-7ba12ab6e34e service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.955629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:17.835915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7396-d547-40fc-b835-bc252769dece None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.836491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7396-d547-40fc-b835-bc252769dece None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.836491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7396-d547-40fc-b835-bc252769dece None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.837813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:17.843922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09496-f6a0-4589-9feb-2b25b3a65160 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.844694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09496-f6a0-4589-9feb-2b25b3a65160 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.844846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09496-f6a0-4589-9feb-2b25b3a65160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.867982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a5b09496-f6a0-4589-9feb-2b25b3a65160 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:17.869198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5b09496-f6a0-4589-9feb-2b25b3a65160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.877608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:18.025100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7396-d547-40fc-b835-bc252769dece None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.043321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7396-d547-40fc-b835-bc252769dece None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.054664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.055287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.055565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.055830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.064450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.066043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e016938-8507-4397-9ad8-5a243693d7c1 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.075299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:20.185351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7299-c7b4-4ace-acfa-9f3050f0b929 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:20.185985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7299-c7b4-4ace-acfa-9f3050f0b929 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:20.185985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7299-c7b4-4ace-acfa-9f3050f0b929 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:20.187566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:20.194087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4c34-be74-47cd-a950-82f06c48ce76 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:20.194541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4c34-be74-47cd-a950-82f06c48ce76 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:20.194676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4c34-be74-47cd-a950-82f06c48ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:20.215097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-076a4c34-be74-47cd-a950-82f06c48ce76 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:20.216303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-076a4c34-be74-47cd-a950-82f06c48ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:20.226029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:20.264553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7299-c7b4-4ace-acfa-9f3050f0b929 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:20.276132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7299-c7b4-4ace-acfa-9f3050f0b929 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:20.280479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:20.281138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:20.281420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:20.281708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:20.291507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:20.292981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664087-7256-4584-9440-28e794d69ecb service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:20.302490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:22.747922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173daa-783a-4057-b44b-875b855494ae None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:22.748562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173daa-783a-4057-b44b-875b855494ae None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:22.748562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173daa-783a-4057-b44b-875b855494ae None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:22.749856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:22.756249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eb76-68cd-4f90-bced-4a0a02ea6fb0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:22.757083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eb76-68cd-4f90-bced-4a0a02ea6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:22.757272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eb76-68cd-4f90-bced-4a0a02ea6fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:22.784370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-df79eb76-68cd-4f90-bced-4a0a02ea6fb0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:22.785583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-df79eb76-68cd-4f90-bced-4a0a02ea6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:22.793841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:22.831798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173daa-783a-4057-b44b-875b855494ae None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:22.843707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173daa-783a-4057-b44b-875b855494ae None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:22.848151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:22.848816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:22.849094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:22.849727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:22.859618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:22.861096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78a8fa-28a3-4888-abb9-c9f70a1bd9a8 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:22.870854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:30:25.366963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa7a1-aa8a-4935-bfff-47ec48440711 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:25.367588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa7a1-aa8a-4935-bfff-47ec48440711 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:25.367588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa7a1-aa8a-4935-bfff-47ec48440711 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:25.368972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:25.377711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a84c6-7787-4ad3-ba18-aed07c34835d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:25.378179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a84c6-7787-4ad3-ba18-aed07c34835d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:25.378179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a84c6-7787-4ad3-ba18-aed07c34835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:25.397500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5d0a84c6-7787-4ad3-ba18-aed07c34835d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:25.398667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5d0a84c6-7787-4ad3-ba18-aed07c34835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:25.406826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:25.444755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa7a1-aa8a-4935-bfff-47ec48440711 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:25.458642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa7a1-aa8a-4935-bfff-47ec48440711 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:25.463144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:25.463800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:25.464076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:25.464350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:25.474810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:25.476310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d3cb3-efb4-4f1e-b937-e8fe0a12aa5a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:25.485788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:27.839603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85b8f-5b07-4189-bca9-75b715bdf536 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:27.840158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85b8f-5b07-4189-bca9-75b715bdf536 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:27.840158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85b8f-5b07-4189-bca9-75b715bdf536 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:27.841660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:27.847625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ff73-7aff-4ed6-944c-7b102e9559ca None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:27.848082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ff73-7aff-4ed6-944c-7b102e9559ca None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:27.848192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ff73-7aff-4ed6-944c-7b102e9559ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:27.867058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cd87ff73-7aff-4ed6-944c-7b102e9559ca None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:27.868267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cd87ff73-7aff-4ed6-944c-7b102e9559ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:27.877378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:27.915109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85b8f-5b07-4189-bca9-75b715bdf536 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:27.925960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85b8f-5b07-4189-bca9-75b715bdf536 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:27.930943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:27.931619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:27.931903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:27.932178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:27.941881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:27.943338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcbc8d-5349-4215-adb7-7468cd0bc4ee service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:27.953115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:30.232978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540646-e681-413e-8017-792dd1e46725 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:30.233586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540646-e681-413e-8017-792dd1e46725 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:30.233586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540646-e681-413e-8017-792dd1e46725 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:30.234893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:30.242919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879777af-3799-4c0d-ab09-b149711af2e6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:30.243609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879777af-3799-4c0d-ab09-b149711af2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:30.243609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879777af-3799-4c0d-ab09-b149711af2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:30.264590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-879777af-3799-4c0d-ab09-b149711af2e6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:30.265800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-879777af-3799-4c0d-ab09-b149711af2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:30.274183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:30.311252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51540646-e681-413e-8017-792dd1e46725 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:30.323132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51540646-e681-413e-8017-792dd1e46725 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:30.326909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:30.327546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:30.327819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:30.328085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:30.337462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:30.338925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d9f28-7195-4a56-a7b4-1a5690a49fbb service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:30.349328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:32.624093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4a4a-6054-4c72-b462-4ba69de58995 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:32.624766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4a4a-6054-4c72-b462-4ba69de58995 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:32.624766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4a4a-6054-4c72-b462-4ba69de58995 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:32.626097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:32.631699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a6e7e-78e9-45a7-ab86-dd63c7a13b87 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:32.632173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a6e7e-78e9-45a7-ab86-dd63c7a13b87 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:32.632274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a6e7e-78e9-45a7-ab86-dd63c7a13b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:32.651994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6c8a6e7e-78e9-45a7-ab86-dd63c7a13b87 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:32.653238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6c8a6e7e-78e9-45a7-ab86-dd63c7a13b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:32.662065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:32.699973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4a4a-6054-4c72-b462-4ba69de58995 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:32.711212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4a4a-6054-4c72-b462-4ba69de58995 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:32.715023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:32.715675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:32.715949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:32.716237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:32.726168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:32.727625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dd67-b53a-4c0f-a4bb-57b5b12b400c service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:32.737460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:35.024190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19c3d-66c8-4f35-972a-7368f6068be0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:35.024190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19c3d-66c8-4f35-972a-7368f6068be0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:35.024190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19c3d-66c8-4f35-972a-7368f6068be0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:35.024190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:35.030443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dd1-7bd4-45f5-8bc7-a7588cbe2c2b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:35.031296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dd1-7bd4-45f5-8bc7-a7588cbe2c2b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:35.031784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dd1-7bd4-45f5-8bc7-a7588cbe2c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:35.049242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-23fb4dd1-7bd4-45f5-8bc7-a7588cbe2c2b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:35.050429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-23fb4dd1-7bd4-45f5-8bc7-a7588cbe2c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:35.058241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:35.096651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19c3d-66c8-4f35-972a-7368f6068be0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:35.111222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19c3d-66c8-4f35-972a-7368f6068be0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:35.115898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:35.117069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:35.117354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:35.117628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:35.130138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:35.131574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95503b6-43b7-49b5-b891-7921966c1323 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:35.140992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:37.374505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bbf6a-44cd-48c5-a06f-7f18bb954b35 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:37.375373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bbf6a-44cd-48c5-a06f-7f18bb954b35 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:37.375555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bbf6a-44cd-48c5-a06f-7f18bb954b35 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:37.377856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:37.384146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6565-12d3-4695-93b0-9ed16a07a24e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:37.384934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6565-12d3-4695-93b0-9ed16a07a24e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:37.385096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6565-12d3-4695-93b0-9ed16a07a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:37.404670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b30e6565-12d3-4695-93b0-9ed16a07a24e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:37.405897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b30e6565-12d3-4695-93b0-9ed16a07a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:37.413999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:37.451070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bbf6a-44cd-48c5-a06f-7f18bb954b35 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:37.468197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bbf6a-44cd-48c5-a06f-7f18bb954b35 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:37.472824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:37.473822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:37.474099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:37.474374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:37.484124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:37.485624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab104-fc56-43a1-9f83-81f285544455 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:37.495302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:39.693932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5767-2aba-4153-b5e6-9fa3f5c86d00 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:39.694469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5767-2aba-4153-b5e6-9fa3f5c86d00 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:39.694469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5767-2aba-4153-b5e6-9fa3f5c86d00 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:39.695835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:39.702270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228ed1-f9cd-483e-986f-cf8d7e54abd9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:39.702721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228ed1-f9cd-483e-986f-cf8d7e54abd9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:39.702829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228ed1-f9cd-483e-986f-cf8d7e54abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:39.725819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-96228ed1-f9cd-483e-986f-cf8d7e54abd9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:39.727016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-96228ed1-f9cd-483e-986f-cf8d7e54abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:39.736337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:39.771772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc5767-2aba-4153-b5e6-9fa3f5c86d00 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:39.784384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc5767-2aba-4153-b5e6-9fa3f5c86d00 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:39.788873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:39.789505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:39.789789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:39.790057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:39.799293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:39.800774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362065c6-2ae1-4d84-bd26-55bcb1bbd3cb service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:39.810538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:42.034541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d79f-f299-41a2-9293-57070011912a None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:42.035183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d79f-f299-41a2-9293-57070011912a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:42.035183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d79f-f299-41a2-9293-57070011912a None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:42.036463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:30:42.042964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda522f6-6cdc-4943-bfd5-48a93d130a78 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:42.043422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda522f6-6cdc-4943-bfd5-48a93d130a78 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:42.043536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda522f6-6cdc-4943-bfd5-48a93d130a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:42.068135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fda522f6-6cdc-4943-bfd5-48a93d130a78 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:42.069369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fda522f6-6cdc-4943-bfd5-48a93d130a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:42.078464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:42.114432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d79f-f299-41a2-9293-57070011912a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:42.126393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d79f-f299-41a2-9293-57070011912a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:42.130207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:42.130845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:42.131127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:42.131402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:42.140809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:42.142236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d68752-e74c-43a9-a5e3-ba4dc14ea181 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:42.151500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:14.888881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3e1c-7c28-451e-b24a-98de31494afd None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:14.889512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3e1c-7c28-451e-b24a-98de31494afd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:14.889512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3e1c-7c28-451e-b24a-98de31494afd None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:14.891570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:14.899394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a74a-f545-4bc6-aa65-96dacc0da951 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:14.899876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a74a-f545-4bc6-aa65-96dacc0da951 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:14.900017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a74a-f545-4bc6-aa65-96dacc0da951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:14.919309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4489a74a-f545-4bc6-aa65-96dacc0da951 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:14.920420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4489a74a-f545-4bc6-aa65-96dacc0da951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:14.928776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:14.975009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673f657-6d4f-46dc-a34a-524a380c886a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:14.975308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673f657-6d4f-46dc-a34a-524a380c886a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:14.975564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673f657-6d4f-46dc-a34a-524a380c886a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:14.976964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 962 bytes} [Mon May 16 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:14.981828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20638e-d0d1-4ca4-9336-049017f21b64 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:14.982115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20638e-d0d1-4ca4-9336-049017f21b64 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:14.982387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20638e-d0d1-4ca4-9336-049017f21b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:15.001082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6a20638e-d0d1-4ca4-9336-049017f21b64 None None] MFA Rules not processed for user `ec2c313f5a654d159c98a2f88b8f4d55`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:15.002260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6a20638e-d0d1-4ca4-9336-049017f21b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:15.010006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Mon May 16 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:15.017211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673f657-6d4f-46dc-a34a-524a380c886a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:15.029297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673f657-6d4f-46dc-a34a-524a380c886a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:15.033501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:15.034120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:15.034400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:15.034675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:15.043718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:15.045172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eefab-37c0-4567-ace6-cd2f6a34373c service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:15.054412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:17.357911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9291-9da3-4468-843e-f9bad8c4d7d5 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:17.358555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9291-9da3-4468-843e-f9bad8c4d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:17.358555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9291-9da3-4468-843e-f9bad8c4d7d5 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:17.359883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:17.368745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7500-257c-475d-9fb9-ca8a6cdef99c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:17.369223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7500-257c-475d-9fb9-ca8a6cdef99c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:17.369343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7500-257c-475d-9fb9-ca8a6cdef99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:17.387850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-df2b7500-257c-475d-9fb9-ca8a6cdef99c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:17.389065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-df2b7500-257c-475d-9fb9-ca8a6cdef99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:17.397957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:17.421254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9291-9da3-4468-843e-f9bad8c4d7d5 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:17.441745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9291-9da3-4468-843e-f9bad8c4d7d5 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:17.450929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:17.451564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:17.452158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:17.452473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:17.453205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:17.454986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:31:17.454986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:31:17.454986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:31:17.456113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4164f-8377-4022-8d58-c584a6179b36 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:17.476143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 16 20:31:17 2022] GET /identity/v3/projects => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:19.713038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556435a-5e24-49a9-84d6-eb918c10439e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:19.713602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556435a-5e24-49a9-84d6-eb918c10439e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:19.713602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556435a-5e24-49a9-84d6-eb918c10439e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:19.715013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:19.721999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61710a-fa4b-430e-ae75-5c44b690b5ca None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:19.722712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61710a-fa4b-430e-ae75-5c44b690b5ca None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:19.722910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61710a-fa4b-430e-ae75-5c44b690b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:19.749366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5b61710a-fa4b-430e-ae75-5c44b690b5ca None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:19.750592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5b61710a-fa4b-430e-ae75-5c44b690b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:19.759943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:19.801638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556435a-5e24-49a9-84d6-eb918c10439e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:19.817444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556435a-5e24-49a9-84d6-eb918c10439e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:19.824640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:19.825305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:19.825582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:19.825851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:19.834420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:19.836012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46feca-70a5-4b39-ad7c-0a63b6b2d2d4 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:19.846302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:22.253449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095585-689e-41bb-b7eb-e0caa1367bb4 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:22.254436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095585-689e-41bb-b7eb-e0caa1367bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:22.254436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095585-689e-41bb-b7eb-e0caa1367bb4 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:22.256508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:22.262713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9fe79-4e08-4949-b0fa-c83f10f2f243 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:22.263182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9fe79-4e08-4949-b0fa-c83f10f2f243 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:22.263275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9fe79-4e08-4949-b0fa-c83f10f2f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:22.285984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-68a9fe79-4e08-4949-b0fa-c83f10f2f243 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:22.287836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-68a9fe79-4e08-4949-b0fa-c83f10f2f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:22.297978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:22.336293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8095585-689e-41bb-b7eb-e0caa1367bb4 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:22.350545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8095585-689e-41bb-b7eb-e0caa1367bb4 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:22.355695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:22.356344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:22.356651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:22.356917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:22.366684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:22.368156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8eea-f694-40eb-89f4-e4b5006b6caa service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:22.377861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:24.632099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727caec-1dcf-4459-9541-b966604948f1 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:24.632892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727caec-1dcf-4459-9541-b966604948f1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:24.632892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727caec-1dcf-4459-9541-b966604948f1 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:24.635070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:24.641800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6576-fd24-4f41-a2c2-337d6871a70e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:24.642518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6576-fd24-4f41-a2c2-337d6871a70e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:24.642727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6576-fd24-4f41-a2c2-337d6871a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:24.663047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e51f6576-fd24-4f41-a2c2-337d6871a70e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:24.665114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e51f6576-fd24-4f41-a2c2-337d6871a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:24.674868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:24.714966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727caec-1dcf-4459-9541-b966604948f1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:24.727547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727caec-1dcf-4459-9541-b966604948f1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:24.732256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:24.732930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:24.733213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:24.733488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:24.742618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:24.744141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c52247-1256-445d-8f84-e57cf6de862a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:24.753412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:27.086665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30021-5ebf-4985-81ab-665e38ca8ecd None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.087209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30021-5ebf-4985-81ab-665e38ca8ecd None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.087209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30021-5ebf-4985-81ab-665e38ca8ecd None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.088751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:27.094263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903f93-eb50-44d2-9e6a-3cbfafd8093b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.094806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903f93-eb50-44d2-9e6a-3cbfafd8093b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.094806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903f93-eb50-44d2-9e6a-3cbfafd8093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.113330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-26903f93-eb50-44d2-9e6a-3cbfafd8093b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:27.114539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-26903f93-eb50-44d2-9e6a-3cbfafd8093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:27.123157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:27.162307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30021-5ebf-4985-81ab-665e38ca8ecd None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.174853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30021-5ebf-4985-81ab-665e38ca8ecd None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.179046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.179686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.179959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.180236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.195253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.197465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9770cb-6cc9-4bb6-8f61-e4ab55d3f6ec service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.211767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:29.721983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e57c6-b3b3-4743-99b9-3f6c038dea42 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:29.722571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e57c6-b3b3-4743-99b9-3f6c038dea42 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:29.722571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e57c6-b3b3-4743-99b9-3f6c038dea42 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:29.723912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 16 20:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:31:29.730481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90cb0-ce66-4dc2-8f6d-e8ec4b102eb4 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:29.731188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90cb0-ce66-4dc2-8f6d-e8ec4b102eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:29.731295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90cb0-ce66-4dc2-8f6d-e8ec4b102eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:29.753405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-05d90cb0-ce66-4dc2-8f6d-e8ec4b102eb4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:29.754567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-05d90cb0-ce66-4dc2-8f6d-e8ec4b102eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:29.763235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 16 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:29.805015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e57c6-b3b3-4743-99b9-3f6c038dea42 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:29.825785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e57c6-b3b3-4743-99b9-3f6c038dea42 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:29.832080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:29.832955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:29.833378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:29.833667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:29.847366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:29.849423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567952eb-0e89-4514-9608-4bd8b87b0970 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:29.860237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:33:09.925995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:09.926623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:09.926623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:09.950927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:09.952173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:09.965485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:09.977866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:09.978667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:09.978816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.001540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:10.002717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:10.012356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:10.019139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.029612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fba3a-2aca-4862-9311-fba09964c9c5 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.035557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.036213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.036522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.036792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.037854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:33:10.038176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.039355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.039355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:33:10.039355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:33:10.040138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.053056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:33:10.061631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.070818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a69a6-db6f-4076-b780-1c8b9e41bb98 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.076945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.077603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.077883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.078152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.078881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.080800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.080800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:33:10.080800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:33:10.082006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.119997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:33:10 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:33:10.124403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.134192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc89dd-9c3d-46dc-9c67-979fa3802a0b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.189672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.190288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.190568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.190841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.191527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.192575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.192575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:33:10.192575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:33:10.193772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.216578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:33:10 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:33:10.221485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.236299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75216ea7-8593-4fea-994e-84159af1ad83 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.243179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.243844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.244124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.244393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.245255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.246273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.246273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:33:10.246273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:33:10.247228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.260951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:33:10.265431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.276259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab9bb-4da4-4e39-8016-389ba54e615c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.281842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.282507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.282792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.283067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.283856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.284918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.284918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:33:10.284918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:33:10.285791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78585991-aad8-404f-bb94-dccded57e112 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.299620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:33:10.303974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.313912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d515-c766-4ab8-9852-9f0b743ed841 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.318674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.319547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.319824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.320092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] PATH_INFO: `/v3/projects/47549feea5544a8fa77332343e664f03/users/ba68f6b496ac421b8ea668b00e0e805b/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.334703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47549feea5544a8fa77332343e664f03, user_id=ba68f6b496ac421b8ea668b00e0e805b, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.335736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.335736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:33:10.335736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:33:10.337694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554cac-bd52-4311-9b50-22b7b8246fe3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.352167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:33:10 2022] PUT /identity/v3/projects/47549feea5544a8fa77332343e664f03/users/ba68f6b496ac421b8ea668b00e0e805b/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:10.363881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b1f1-bf87-4d05-810a-337502153fb0 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.364213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b1f1-bf87-4d05-810a-337502153fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.364479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b1f1-bf87-4d05-810a-337502153fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.391888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-65f8b1f1-bf87-4d05-810a-337502153fb0 None None] MFA Rules not processed for user `ba68f6b496ac421b8ea668b00e0e805b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:10.393147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-65f8b1f1-bf87-4d05-810a-337502153fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:10.457151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:33:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:10.474477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7d05-8ffd-467e-829c-1de39dc45af2 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.474764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7d05-8ffd-467e-829c-1de39dc45af2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.475038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7d05-8ffd-467e-829c-1de39dc45af2 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.476472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 963 bytes} [Mon May 16 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:33:10.481328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659985a8-402e-4ce2-8061-24a2ae6aa385 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.481615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659985a8-402e-4ce2-8061-24a2ae6aa385 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.481888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659985a8-402e-4ce2-8061-24a2ae6aa385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.500156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-659985a8-402e-4ce2-8061-24a2ae6aa385 None None] MFA Rules not processed for user `d46868d054b34480935d579ea9b22171`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:10.501755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-659985a8-402e-4ce2-8061-24a2ae6aa385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:10.556582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Mon May 16 20:33:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:10.564258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7d05-8ffd-467e-829c-1de39dc45af2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.576977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7d05-8ffd-467e-829c-1de39dc45af2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.581733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.582392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.582679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.582951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.592238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.594078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.603303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:33:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:33:10.649559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda140f-bd7c-4c10-bc85-c814ab5017fc None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.649850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda140f-bd7c-4c10-bc85-c814ab5017fc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.650128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda140f-bd7c-4c10-bc85-c814ab5017fc None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.651439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 829 bytes} [Mon May 16 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:33:10.655216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.725732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9248e3b-d4c4-4daf-8c3e-383e809d764d service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:10.731674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:10.732585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.732850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.733122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] PATH_INFO: `/v3/users/ba68f6b496ac421b8ea668b00e0e805b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.734518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba68f6b496ac421b8ea668b00e0e805b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:10.735560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:10.735560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:33:10.735560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:33:10.736921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:10.810337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba68f6b496ac421b8ea668b00e0e805b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:10.811006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba68f6b496ac421b8ea668b00e0e805b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:10.830999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba68f6b496ac421b8ea668b00e0e805b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:10.843841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba68f6b496ac421b8ea668b00e0e805b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:10.854069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba68f6b496ac421b8ea668b00e0e805b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:10.860390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:33:10 2022] DELETE /identity/v3/users/ba68f6b496ac421b8ea668b00e0e805b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:10.864995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:10.865308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:10.865611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:10.883218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:10.884444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:10.951875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:10.963412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:10.965013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:11.024230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fe6f-1f4a-4121-848f-1daf637fea47 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:11.030073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:11.030900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:11.031179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:11.031455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:11.045676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:11.047891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3101313-d8fe-48b9-8262-defe926713f3 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:11.058403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:33:11.413438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:11.414899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:11.427181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01c9c2-be09-4de6-8160-32c679319b36 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:11.431880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:11.432796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:11.433110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:11.433371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] PATH_INFO: `/v3/projects/47549feea5544a8fa77332343e664f03` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:11.434560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47549feea5544a8fa77332343e664f03)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:11.435581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:33:11.435581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:33:11.435581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:33:11.436814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:11.502438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47549feea5544a8fa77332343e664f03', 'request_id': 'req-dc455417-5eb9-43e1-a881-6f08d5baace4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:11.508720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47549feea5544a8fa77332343e664f03', 'request_id': 'req-dc455417-5eb9-43e1-a881-6f08d5baace4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:11.518778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47549feea5544a8fa77332343e664f03', 'request_id': 'req-dc455417-5eb9-43e1-a881-6f08d5baace4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:11.536679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] The token cache is being invalidate because project 47549feea5544a8fa77332343e664f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:33:11.536898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:11.537521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-dc455417-5eb9-43e1-a881-6f08d5baace4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:11.539180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:33:11 2022] DELETE /identity/v3/projects/47549feea5544a8fa77332343e664f03 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:49.156896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:49.157505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:49.157505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:49.159577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:34:49.167421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39310d9-d914-4cf4-a24a-9cac3ac9850e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:49.168191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39310d9-d914-4cf4-a24a-9cac3ac9850e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:49.168344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39310d9-d914-4cf4-a24a-9cac3ac9850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:49.190144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a39310d9-d914-4cf4-a24a-9cac3ac9850e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:49.191380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a39310d9-d914-4cf4-a24a-9cac3ac9850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:49.252719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:49.427409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:49.429663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:49.513024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36626-9128-4d18-93a2-75b024cc10df None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:49.519203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:49.519843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:49.520123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:49.520397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:49.529206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:49.530850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f2d71-19af-49b5-bea1-cd10ac468940 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:49.540315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:34:50.439427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497fea-3c26-401d-a9e0-4fd51748e27d None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:50.440020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497fea-3c26-401d-a9e0-4fd51748e27d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:50.440020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497fea-3c26-401d-a9e0-4fd51748e27d None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:50.441436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:34:50.446418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:50.446874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:50.446990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:50.454342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c552-689e-49ba-8671-97ba45f3a491 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:50.454633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c552-689e-49ba-8671-97ba45f3a491 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:50.454914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c552-689e-49ba-8671-97ba45f3a491 None None] PATH_INFO: `/v3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:50.456146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 757/1515] 10.222.0.60 () {54 vars in 925 bytes} [Mon May 16 20:34:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:34:50.462339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d125-1df4-46e1-bd5b-e9ef18642b3e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:50.462629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d125-1df4-46e1-bd5b-e9ef18642b3e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:50.462874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d125-1df4-46e1-bd5b-e9ef18642b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:50.466760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:50.468311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:50.476813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 759/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:50.482327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1a90d125-1df4-46e1-bd5b-e9ef18642b3e None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:50.483558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1a90d125-1df4-46e1-bd5b-e9ef18642b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:50.547790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 758/1517] 10.222.0.60 () {58 vars in 1015 bytes} [Mon May 16 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:50.627793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:50.641436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b754868-b22b-4ecf-b768-c4bede1d3a6d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:50.647798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:50.648454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:50.649117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:50.649388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:50.658913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:50.660562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d5baf-7289-4e35-ae43-417f16085be4 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:50.670613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 760/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:34:54.394526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caf9e3-2b29-4077-a8c8-0f91fe59e793 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:54.395099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caf9e3-2b29-4077-a8c8-0f91fe59e793 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:54.395099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caf9e3-2b29-4077-a8c8-0f91fe59e793 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:54.396933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 759/1519] 10.222.0.49 () {54 vars in 960 bytes} [Mon May 16 20:34:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:34:54.402489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983331d7-4520-4ce5-a096-1ca23b6af83e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:54.402931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983331d7-4520-4ce5-a096-1ca23b6af83e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:54.403067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983331d7-4520-4ce5-a096-1ca23b6af83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:54.427766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-983331d7-4520-4ce5-a096-1ca23b6af83e None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:54.429005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-983331d7-4520-4ce5-a096-1ca23b6af83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:54.439023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 761/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Mon May 16 20:34:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:54.446911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caf9e3-2b29-4077-a8c8-0f91fe59e793 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:54.461066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caf9e3-2b29-4077-a8c8-0f91fe59e793 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:54.466395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:54.467031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:54.467313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:54.467586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:54.475886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:54.477526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a0ad-1d43-41d4-b5a9-d473c3a05356 service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:54.487110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 760/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:34:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:02.006781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e037b-5b23-415d-9bda-5e6225b50388 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:02.007347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e037b-5b23-415d-9bda-5e6225b50388 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:02.007347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e037b-5b23-415d-9bda-5e6225b50388 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:02.008675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:02.014790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b21b-3908-480d-a569-c64388a3946f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:02.015589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b21b-3908-480d-a569-c64388a3946f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:02.015589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b21b-3908-480d-a569-c64388a3946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:02.043376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-dda7b21b-3908-480d-a569-c64388a3946f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:02.044635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dda7b21b-3908-480d-a569-c64388a3946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:02.053861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:35:02.210232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e037b-5b23-415d-9bda-5e6225b50388 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:02.235794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e037b-5b23-415d-9bda-5e6225b50388 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:02.244273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:02.244939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:02.245218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:02.245482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:02.253827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:02.255419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9193dd-8a54-4dbe-a960-5800c35f3301 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:02.264962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 763/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:03.160600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d2ed-9cd8-45ab-baaf-608a8980ca4a None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:03.161492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d2ed-9cd8-45ab-baaf-608a8980ca4a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:03.161492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d2ed-9cd8-45ab-baaf-608a8980ca4a None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:03.163677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:03.169567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c17e-7eb2-4ecb-bc5a-ba8529aad1f0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:03.170252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c17e-7eb2-4ecb-bc5a-ba8529aad1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:03.170580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c17e-7eb2-4ecb-bc5a-ba8529aad1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:03.192360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-67b1c17e-7eb2-4ecb-bc5a-ba8529aad1f0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:03.193575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-67b1c17e-7eb2-4ecb-bc5a-ba8529aad1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:03.202308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:35:03.360409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603d2ed-9cd8-45ab-baaf-608a8980ca4a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:03.383854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603d2ed-9cd8-45ab-baaf-608a8980ca4a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:03.391196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:03.391889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:03.392202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:03.392516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:03.401006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:03.402624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f91c47-ef60-40ff-b0f6-875bb8e8d2b0 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:03.412695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 763/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:07.378784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:07.379402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:07.379402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:07.380760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:07.386071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f842d-3eee-42c8-ad7a-49aa2fc50f40 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:07.386546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f842d-3eee-42c8-ad7a-49aa2fc50f40 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:07.386696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f842d-3eee-42c8-ad7a-49aa2fc50f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:07.408743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d52f842d-3eee-42c8-ad7a-49aa2fc50f40 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:07.409975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d52f842d-3eee-42c8-ad7a-49aa2fc50f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:07.418115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:35:07.454544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:07.457728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:07.525744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7d48-e119-4d47-bbf7-3ee5a5cedf4a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:07.530650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:07.531294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:07.531575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:07.531849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:07.541219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:07.542652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4aaa-893f-45c4-975d-885c40ac2eca service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:07.552950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 766/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:09.756770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:09.757521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:09.757521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:09.759517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:09.767736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c620252-785f-45b0-a0c3-50f73734b773 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:09.768224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c620252-785f-45b0-a0c3-50f73734b773 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:09.768329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c620252-785f-45b0-a0c3-50f73734b773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:09.787401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6c620252-785f-45b0-a0c3-50f73734b773 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:09.788629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6c620252-785f-45b0-a0c3-50f73734b773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:09.796612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:35:09.832878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:09.834992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:09.850423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cff6f-96d4-4a24-b85e-97408b107429 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:09.854617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:09.855242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:09.855524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:09.855799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:09.866466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:09.867966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665977c4-7102-49f9-818b-852eee70f965 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:09.877887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 766/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:13.618249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:13.618895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:13.618895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:13.620328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:13.626856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f336df3-a501-4f6c-b927-9c0039573cc1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:13.627622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f336df3-a501-4f6c-b927-9c0039573cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:13.627789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f336df3-a501-4f6c-b927-9c0039573cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:13.649301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-7f336df3-a501-4f6c-b927-9c0039573cc1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:13.650507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7f336df3-a501-4f6c-b927-9c0039573cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:13.659971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:35:13.929444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:13.931548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:13.990832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1922e75-bc54-46f3-9f23-068fd5e74229 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:13.995028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:13.995667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:13.995949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:13.996224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:14.005796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:14.007216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b2481-40e4-4b90-b349-e97d711bec29 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:14.016739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 769/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:16.273805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:16.274692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:16.274692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:16.277061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:35:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:35:16.283065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942197-da54-4444-a1e0-599e330df612 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:16.283515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942197-da54-4444-a1e0-599e330df612 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:16.283621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942197-da54-4444-a1e0-599e330df612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:16.302932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-77942197-da54-4444-a1e0-599e330df612 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:16.304115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-77942197-da54-4444-a1e0-599e330df612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:16.312631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:35:16.585139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:16.588337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:16.603690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719215-49a9-4b5f-8a48-b126edc2537c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:16.607838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:16.608487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:16.608771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:16.609042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:16.618265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:16.620008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b9a54-f439-4da3-9816-4786c9f75a0f service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:16.632302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 769/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:44.783607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.784261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.784352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.816247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:44.817465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.828000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 771/1540] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:44.838506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.839097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.839097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.869461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:44.870767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.879351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:44.884352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.894542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc94e-865b-4d17-8520-fb77f303a18a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.904801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.905504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.905781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.906108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.906849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:44.907151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.908237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:36:44.908237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:36:44.908237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:36:44.909129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f816b1-c561-4288-ae75-d61909b1455d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.928694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 772/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:44.931989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.942185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37f55e-07bf-4264-8964-07a1a26e837e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.951459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.952168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.952457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.952748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.953595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.956304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964bae-c58b-4e47-9e6f-648e47ff26ef None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.956631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964bae-c58b-4e47-9e6f-648e47ff26ef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.956906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964bae-c58b-4e47-9e6f-648e47ff26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.962081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:36:44.962081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:36:44.962081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:36:44.963500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c78606-3396-46ea-9b42-048c3162250a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.048136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 771/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:45.064747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.065097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.065307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.098429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.099891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.229492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a2964bae-c58b-4e47-9e6f-648e47ff26ef None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.230664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a2964bae-c58b-4e47-9e6f-648e47ff26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.242041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 772/1544] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:45.243778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.253518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 773/1545] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:45.255207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfe95-e78d-4559-9d90-f02bb1d492b2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.255704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfe95-e78d-4559-9d90-f02bb1d492b2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.256173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfe95-e78d-4559-9d90-f02bb1d492b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.270538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321035-a1d7-4891-b4dc-a729a0f54fba None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.284522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.285572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.286065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.286534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.286807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-96adfe95-e78d-4559-9d90-f02bb1d492b2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.287807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.287999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-96adfe95-e78d-4559-9d90-f02bb1d492b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.290262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6ac7-5bdd-4092-b4b5-67345260f061 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.304313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 774/1546] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.307930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2703d2-6d04-4844-b69e-b12b7d77941e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.307930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2703d2-6d04-4844-b69e-b12b7d77941e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.307930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2703d2-6d04-4844-b69e-b12b7d77941e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.323178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 773/1547] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/users => generated 284 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.324951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9006f-589f-4ebe-814a-8ec767296159 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.325415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9006f-589f-4ebe-814a-8ec767296159 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.325955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9006f-589f-4ebe-814a-8ec767296159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.331960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1b2703d2-6d04-4844-b69e-b12b7d77941e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.333354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b2703d2-6d04-4844-b69e-b12b7d77941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.345047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 775/1548] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.346350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.346628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.346896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.350277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-acd9006f-589f-4ebe-814a-8ec767296159 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.351869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-acd9006f-589f-4ebe-814a-8ec767296159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.359691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 774/1549] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.360999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1e46-2806-4ce0-939d-7880636641de None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.361286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1e46-2806-4ce0-939d-7880636641de None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.361562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1e46-2806-4ce0-939d-7880636641de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.366700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.367883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.375864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 776/1550] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.376666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.378890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-995d1e46-2806-4ce0-939d-7880636641de None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.380067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-995d1e46-2806-4ce0-939d-7880636641de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.385801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661f991-e3b1-4e2f-bc7d-19351d9d7fde None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.388160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 775/1551] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.389455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0abc-63ed-4427-b1b9-8090ca2aff04 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.389740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0abc-63ed-4427-b1b9-8090ca2aff04 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.390012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0abc-63ed-4427-b1b9-8090ca2aff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.393523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.394181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.394457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.394726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.395450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.397089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911c5ff-abf7-4914-9ab1-9e2b0057958f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.407115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 777/1552] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:45.407691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2cb0abc-63ed-4427-b1b9-8090ca2aff04 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.408312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.408616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.408890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2cb0abc-63ed-4427-b1b9-8090ca2aff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.409043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.416627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.418119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8c89a-9e31-436d-9534-428e39e69bbc None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.418407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8c89a-9e31-436d-9534-428e39e69bbc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.418681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8c89a-9e31-436d-9534-428e39e69bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.426328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.427510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.435268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.436025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.436509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1ad8c89a-9e31-436d-9534-428e39e69bbc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.437748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1ad8c89a-9e31-436d-9534-428e39e69bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.445041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59447a-8e07-469a-9544-61f3a5d54f43 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.445669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.447047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.447342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.447622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.449695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.450350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.450659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.450897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.451620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.451920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.453618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45606eb2-590a-4883-941f-f1067c1bde05 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.472009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.472208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.472461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.472461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.472655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.472758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.479980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.480865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.488888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.489925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df4eda-5d28-41bc-aa23-0577cefe3828 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.490106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.494515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.495155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.495433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.495707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.496420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.496773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.497753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.498509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.498625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.507474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604571-c0eb-4b37-b872-21f3c806c78f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.510601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.511723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.511959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.512636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.512920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.513204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.513920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.516261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c264d-01af-427b-81db-0cf94ebfca3a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.528747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1fafb-4dd4-4bf2-be3f-2497b6555f77 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.531364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:45.532713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.533000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.533273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.534776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.535442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.535716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.535986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.536733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.537033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.538631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11543d9-c331-41cf-a4b0-a3a3937dedd6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.551401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.552258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.553197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.553479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.553602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.553797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.561821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.565280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.572042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.573270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.574657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a681260-4a3a-4bcb-89df-fa60ffc74c31 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.579239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.579921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.580231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.580553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.581235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.581975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:45.583126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.585259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.594740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c7d6a-9484-4954-88f3-88509fb3d025 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.599916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.600599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.600902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.601149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.601901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.602204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.603818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.609615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 783/1564] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.610492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.622326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 782/1565] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.622326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.627839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee0780-4265-43bc-b054-7d3ae56ef396 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.670189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca239c9-e13c-4cec-9433-219ce76ec0e6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.675141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.675807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.676090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.676364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.677123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.677426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.679040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.684861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.685545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.685804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.686073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.686753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.688852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.690173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 784/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.690945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.700279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b1fe0-c48e-4949-b047-e6bed3479a5f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.705604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.706631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.706970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.707267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] PATH_INFO: `/v3/projects/5c71264673cd46288ae1e42a5f9e0875/users/10f018886dcf4b6bb734867b239a6ca4/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.716209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 783/1567] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.717040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.726236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c71264673cd46288ae1e42a5f9e0875, user_id=10f018886dcf4b6bb734867b239a6ca4, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.728912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.743113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 785/1568] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:45 2022] PUT /identity/v3/projects/5c71264673cd46288ae1e42a5f9e0875/users/10f018886dcf4b6bb734867b239a6ca4/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:45.743921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.778204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7ff0-01a9-4191-9e46-8d44bcff9b0b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.801544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf939-bb64-4cf5-9066-f1190c8502ea admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.805978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.806631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.806908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.807178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.807895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.808200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.809843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.820956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 786/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.821583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.830798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf99d8-7b28-4b88-9b72-3a97c486fdcc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.835218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.835865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.836130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.836391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.837120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:45.837419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.838991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.839215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.839892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.840174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.840479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.841212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.843121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.850518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 787/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:45.858127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.867351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23305b-1af3-4b25-bc9c-efb6c4461424 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.870815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 784/1571] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.870815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.925962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.926625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.926898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.927172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.927606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa680f-d031-43d3-bd8e-fac901ae9ee0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.927850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.928894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:36:45.928894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:36:45.928894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:36:45.930074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.932160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.932850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.933135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.933411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.934103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.936042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.950204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 788/1572] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.950997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.960388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560795c4-6606-4a29-8876-6dc2ad69dff8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.964776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.965411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.965690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.965955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.966623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.967128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 785/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.968520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5225a-0a77-476c-b8de-33eb35dc631c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.969535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.995238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 789/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:45.996616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.996900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.997170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.021475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] MFA Rules not processed for user `10f018886dcf4b6bb734867b239a6ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:46.022788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:46.029352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505464-62ac-49a7-96dc-f05c11b02de1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.083243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.083975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.084251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 790/1575] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:46.088181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.088181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.088384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.088513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.088513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.094700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66585d-c54c-40bf-9505-7ec49313010e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.099071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.099711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.099986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.100594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.100953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.102858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.112097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 786/1576] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.113072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.124279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d107e-17e7-4131-aecd-78a97fbe70c5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.131631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 791/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.131782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.131898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.132015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.132015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.132015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.132015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.132909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.160626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 787/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.164857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.191244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf963c-8136-4715-965d-a3633a61ff39 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.227477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424e58-7f75-45cf-b7c5-f5e8b4b6bb6d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.232551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.233237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.233535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.233811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.234560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.236178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.246351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 788/1579] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.247119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.247607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.248286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.248600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.248878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.249609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.251605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.256820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f21ae-7a8a-4c91-8a86-7c866a82ceef admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.261518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.262219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.262485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.262814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.263680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.266038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.273646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 792/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.274440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.284148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab180c4-4e5d-4e0a-9f4d-b13b3af5a31d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.286567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 789/1581] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/users => generated 282 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.287425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.292119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.292890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.293244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.293531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.294247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.296176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.317157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 793/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.318302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.327666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415036-ca83-463b-87cf-1a7e96910009 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.332388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.333057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.333339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.333612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.334332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.335926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.343117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6391ca-fc0b-40b8-8b76-91321a19d507 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.346724 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 794/1583] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.346856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.347436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.347562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.347720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.348000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.356953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90593f-2fb8-41c5-b75f-1a93d504f06c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.361420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.362046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.362326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.362596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.363264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.365193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.384983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 795/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.386020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.395399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9192-641b-4f11-9fc7-eb055a383b10 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.399939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.400665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.401012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.401289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.401959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.403162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.403967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.404628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.413316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 790/1585] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:46.414201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.425475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf95e-9cda-466e-be42-b9dc52321132 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.430020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 796/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:46.430020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.433923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.434708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.435351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.435694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.436701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.437507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d7ee-74a8-4b9a-9966-183a2cf1e84a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.438559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.442567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.443322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.443667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.444329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.444877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.446531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.449220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 791/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.450101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.459468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b180e-f09a-4dd0-934b-efa785a1bb1d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.460501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 797/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.464251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.464680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.465599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.466041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.466579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.467834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.469759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.473644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466721ad-8adf-4632-b13c-7286eb5f22f5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.478296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.478946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.479227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.479500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.480285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.481952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.482559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 792/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.483569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.495827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 798/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.495827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.496009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3535-6c3a-4517-bbf6-f2a487341fe6 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.500914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.501526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.501801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.502072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.502795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.504286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76385-7747-4ff1-98ee-23fbb176da4f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.504414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.508952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.509611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.509899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.510175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.510893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.512502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.514903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 793/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.518854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.526920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 799/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.526920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.528591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103811c-e1b5-402b-8804-44d778a9285e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.534449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.535162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.535447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.535722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.536470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.537404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c5d67-27ec-4886-81a2-225f13288cfd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.538114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.542357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.543469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.543579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.543816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] PATH_INFO: `/v3/projects/970ed3a09b3e490399fa39d38e97f9cb/users/de3dd9262fba4830be6c4477628f2061/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.548524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 794/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.552682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.561744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ed3a09b3e490399fa39d38e97f9cb, user_id=de3dd9262fba4830be6c4477628f2061, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.562779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b7e7-221f-43d1-a9b0-03c788e3734e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.564688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.567417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.568083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.568366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.568769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.569380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.571017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.580231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 800/1594] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/970ed3a09b3e490399fa39d38e97f9cb/users/de3dd9262fba4830be6c4477628f2061/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:46.581380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.585345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 795/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.585345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.593018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e0d72-7790-4960-8094-e3632932c8cf admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.643638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ad601-2a1a-4f8f-95df-2e462ee5e4fc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.648722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.649417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.649698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.649972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.650151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.650814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.650943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.651210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.651483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.652231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.652480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.656512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.663797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 801/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.664698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.665905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 796/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.667216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.679373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5c36d-9030-4947-9305-6150245ce4ad admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.679978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e754fa-bcea-4a59-8f8f-2531b78dff93 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.684299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.685264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.685542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.685815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] PATH_INFO: `/v3/projects/ff2f097602f64521be30fcac0c86ca14/users/bd26cc840b9e480b890ca2c1f662ed4c/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.685989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.687014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.687505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.688107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.689102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.691093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.702394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2f097602f64521be30fcac0c86ca14, user_id=bd26cc840b9e480b890ca2c1f662ed4c, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.702869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 797/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.704013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.705173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c69e-672c-4e7b-85ec-435c7e46d37e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.716938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a7c39-4a25-4637-9492-111dafc00047 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.720839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 802/1599] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/ff2f097602f64521be30fcac0c86ca14/users/bd26cc840b9e480b890ca2c1f662ed4c/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:46.722653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.722946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.723230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.742802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:46.744082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:46.785093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.785673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.785952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.786224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.786968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.788607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.803688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 798/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:46.803688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.810524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 803/1601] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:46.811192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a31a-c376-461a-9a40-4d513bab2165 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.814888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.816599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.817607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.817914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.818262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] PATH_INFO: `/v3/projects/3c936d9f5e7445a9829155fc6703a0f0/users/9429845a17224ee7930c907177886aad/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.824806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da4a6-a8cd-43e2-aa77-35b3641cfa1a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.830727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.831750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.832142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.832538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] PATH_INFO: `/v3/projects/00607ca0863848d6b887ad9c198ddf50/users/bed9ae0ddd6646a29d9964a8b6289f56/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.835117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c936d9f5e7445a9829155fc6703a0f0, user_id=9429845a17224ee7930c907177886aad, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.836167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:36:46.836167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:36:46.836167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:36:46.838124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.848789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00607ca0863848d6b887ad9c198ddf50, user_id=bed9ae0ddd6646a29d9964a8b6289f56, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.851460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.852359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 799/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/3c936d9f5e7445a9829155fc6703a0f0/users/9429845a17224ee7930c907177886aad/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:46.857291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.868273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 804/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/00607ca0863848d6b887ad9c198ddf50/users/bed9ae0ddd6646a29d9964a8b6289f56/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:46.869436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.915537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b813f0-84ec-4af6-8b1f-09ac3016cf85 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.930836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05114e7-49af-48d6-9928-c7261bbf938a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.938184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.939150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.939426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.939696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] PATH_INFO: `/v3/projects/79196f5e18734a918f468dc2c497c8dc/users/8969dc33ba644f4a904c9d7c237d559e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.957145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79196f5e18734a918f468dc2c497c8dc, user_id=8969dc33ba644f4a904c9d7c237d559e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.960357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4217-f7cb-4ddd-8373-fce02fe4048b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.975533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 805/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/79196f5e18734a918f468dc2c497c8dc/users/8969dc33ba644f4a904c9d7c237d559e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:46.975746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.976680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.976967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.977242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] PATH_INFO: `/v3/projects/17c116936d14470bb13850d6b8c83f8e/users/0f2fd6d77aa949d5b5919432cb722b37/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.978235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.978744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.979231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.992482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c116936d14470bb13850d6b8c83f8e, user_id=0f2fd6d77aa949d5b5919432cb722b37, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.995165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.010338 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] MFA Rules not processed for user `bd26cc840b9e480b890ca2c1f662ed4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.011576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.016562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 800/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:46 2022] PUT /identity/v3/projects/17c116936d14470bb13850d6b8c83f8e/users/0f2fd6d77aa949d5b5919432cb722b37/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:47.016562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.088587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 806/1606] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.088587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.088884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf10e-73d4-48c5-9805-df1d8ea27c39 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.095125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.096272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.096797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.097240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] PATH_INFO: `/v3/projects/2beaab3a72a345d98a9ec4e0ae4686b6/users/b578680e88c741bda2c8e56b2dc9d335/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.118543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2beaab3a72a345d98a9ec4e0ae4686b6, user_id=b578680e88c741bda2c8e56b2dc9d335, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.121611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c43fa-f137-46c7-a33f-9783a5d0391a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.139380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 801/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:47 2022] PUT /identity/v3/projects/2beaab3a72a345d98a9ec4e0ae4686b6/users/b578680e88c741bda2c8e56b2dc9d335/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:47.143369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69357-028d-4234-9abe-d31c918c533d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.143369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69357-028d-4234-9abe-d31c918c533d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.143369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69357-028d-4234-9abe-d31c918c533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.163640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3f4fb-cb37-4dc2-8f1a-aeb4976525d3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.173131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3ee69357-028d-4234-9abe-d31c918c533d None None] MFA Rules not processed for user `9429845a17224ee7930c907177886aad`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.175049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3ee69357-028d-4234-9abe-d31c918c533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.213479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.214132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.214412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.214687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.244273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 802/1608] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.245609 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175897-bb08-4181-aa44-1a668e63ffa6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.246023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175897-bb08-4181-aa44-1a668e63ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.246463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175897-bb08-4181-aa44-1a668e63ffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.272227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e8175897-bb08-4181-aa44-1a668e63ffa6 None None] MFA Rules not processed for user `bed9ae0ddd6646a29d9964a8b6289f56`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.273452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e8175897-bb08-4181-aa44-1a668e63ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.274385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.275912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a62f-67d0-4836-a6d2-a4ce06f61dd6 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.285351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 807/1609] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:47.286731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427fcd-61d2-433e-9c32-7f0941ae0c81 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.287022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427fcd-61d2-433e-9c32-7f0941ae0c81 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.287300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427fcd-61d2-433e-9c32-7f0941ae0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.314346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a6427fcd-61d2-433e-9c32-7f0941ae0c81 None None] MFA Rules not processed for user `8969dc33ba644f4a904c9d7c237d559e`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.315579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a6427fcd-61d2-433e-9c32-7f0941ae0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.345044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 803/1610] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.346960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6af7-914c-40d9-a57c-c37edd9dcfd2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.347503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6af7-914c-40d9-a57c-c37edd9dcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.347889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6af7-914c-40d9-a57c-c37edd9dcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.368245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-404b6af7-914c-40d9-a57c-c37edd9dcfd2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.369728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-404b6af7-914c-40d9-a57c-c37edd9dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.379202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 804/1611] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.380752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043820-8635-4cdc-a33a-7785d24cd621 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.381102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043820-8635-4cdc-a33a-7785d24cd621 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.381427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043820-8635-4cdc-a33a-7785d24cd621 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.383096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 805/1612] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 16 20:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:36:47.384371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab350697-c2eb-4cf2-9c39-ea64569931f8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.384710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab350697-c2eb-4cf2-9c39-ea64569931f8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.385140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab350697-c2eb-4cf2-9c39-ea64569931f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.388569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 808/1613] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.390358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e70a-9d66-478e-bfc9-0f1ae94da225 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.391297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e70a-9d66-478e-bfc9-0f1ae94da225 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.392613 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e70a-9d66-478e-bfc9-0f1ae94da225 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.394241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 809/1614] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 16 20:36:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:36:47.394940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e70a-9d66-478e-bfc9-0f1ae94da225 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.410012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e70a-9d66-478e-bfc9-0f1ae94da225 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.413391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ab350697-c2eb-4cf2-9c39-ea64569931f8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.414613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ab350697-c2eb-4cf2-9c39-ea64569931f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.415117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.415813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.416054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.416345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.417193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.419363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.426176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 806/1615] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.427416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.427698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.427974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.447807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.449044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.454839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 810/1616] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:47.454839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.519604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72626b-143c-4662-8fb0-5bb2ab4f4dab admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.525021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.525695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.526007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.526260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.526982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.528892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af045a-3ca9-48e3-b9d9-4876aaf6dbb3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.529572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 807/1617] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.530695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.561299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 811/1618] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:47.562745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.562975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.563251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.583168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:47.584624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:47.605677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5040901-818c-47a4-b3a2-8254187c240a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.667061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.667731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.668116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.668469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.689073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 812/1619] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:47.690321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.702156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260771a-d914-4b45-8b3f-7a9d02832e4b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.708228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.709301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.709601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.709924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.748270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.750569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.761189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 808/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:47.761999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.772169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b477-68f9-421b-9094-8864e78976e7 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.779186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.779976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.780747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.781055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.781868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.784808 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.803970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.807093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.819039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 809/1622] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:47.819288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 813/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:47.819910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.821030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.833775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb17c5-114f-4083-8568-f13587c2eff6 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.834694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2412c7-a927-459f-ad78-da181689b8be service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.840870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.841226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.841610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.841890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.843095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.844370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.845378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.845516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.846081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.847220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.878814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 810/1623] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:36:47 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:47.879836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.898793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90187eb-0e76-4435-aba4-65e33e903bdd admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.908254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.909473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.909812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.910107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.918734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.920840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.933603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 814/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:47.947091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:47.971833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d48f-81ba-4bce-a796-cf3430283cec service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:47.977570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.979396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:47.982826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:47.983589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:47.985882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:47.986226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:47.987462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:47.990158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 811/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:47.991241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.001989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97890-e71a-43cf-8ed1-7da43fabb67c service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.003572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.007765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.008830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.009279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.009551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.010507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.012877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.031892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 812/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:48.033222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.043168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 815/1627] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:48.044163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.065370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c2b2-ea16-4b5f-8f50-bc163e5cf0b1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.068577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b116c9-6232-46df-ad3a-bb5757dd79bd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.077863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.079018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.080067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.082359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.083025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] PATH_INFO: `/v3/projects/60d66b022e514f909a3d7074088c05d8/users/c9bea8f2ddfa4b239bccc20506335e99/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.083162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.083162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.084178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] PATH_INFO: `/v3/projects/f836579993384d6e8d8e99ee4627e3a8/users/6ed7c4911f0d40ad94b10b6ef4a75d7b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.118388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d66b022e514f909a3d7074088c05d8, user_id=c9bea8f2ddfa4b239bccc20506335e99, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.121419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f836579993384d6e8d8e99ee4627e3a8, user_id=6ed7c4911f0d40ad94b10b6ef4a75d7b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.128065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.128477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.162517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 813/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:48 2022] PUT /identity/v3/projects/60d66b022e514f909a3d7074088c05d8/users/c9bea8f2ddfa4b239bccc20506335e99/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:48.163746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.167569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 816/1629] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:48 2022] PUT /identity/v3/projects/f836579993384d6e8d8e99ee4627e3a8/users/6ed7c4911f0d40ad94b10b6ef4a75d7b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:48.171751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.315180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8663a07-cb26-45fd-bf82-3fc2f6201fd5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.330288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.330906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.331188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.331463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.332315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.333996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.341203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703465f-6793-4b91-b33b-764749970ad5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.352124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.355004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.355295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.355642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.356390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.363401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.363959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 817/1630] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:36:48.365179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.387106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436e685-2e41-4d9f-b58f-fe474f14fa79 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.389623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 814/1631] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:48.394115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.401076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.402041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.402333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.404388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] PATH_INFO: `/v3/projects/f836579993384d6e8d8e99ee4627e3a8/users/6ed7c4911f0d40ad94b10b6ef4a75d7b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.408774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f836579993384d6e8d8e99ee4627e3a8, user_id=6ed7c4911f0d40ad94b10b6ef4a75d7b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.414215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c68c8-9895-4d82-8c02-450a858f855c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.415830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb765-f727-4b49-94ff-2390657d3c99 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.426147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.429178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.430722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.430722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] PATH_INFO: `/v3/projects/60d66b022e514f909a3d7074088c05d8/users/c9bea8f2ddfa4b239bccc20506335e99/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.437159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d66b022e514f909a3d7074088c05d8, user_id=c9bea8f2ddfa4b239bccc20506335e99, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.438855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 818/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:48 2022] PUT /identity/v3/projects/f836579993384d6e8d8e99ee4627e3a8/users/6ed7c4911f0d40ad94b10b6ef4a75d7b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:48.452919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855450-d01d-40de-a24f-72caf1b0fef2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.453330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855450-d01d-40de-a24f-72caf1b0fef2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.453699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b27ce-34a4-44ce-a25b-e065506682d5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.454474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855450-d01d-40de-a24f-72caf1b0fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.480082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 815/1633] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:36:48 2022] PUT /identity/v3/projects/60d66b022e514f909a3d7074088c05d8/users/c9bea8f2ddfa4b239bccc20506335e99/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:48.494426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4b3-05c0-4214-9685-189608e5dbf6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.494718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4b3-05c0-4214-9685-189608e5dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.494996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4b3-05c0-4214-9685-189608e5dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.513303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-22855450-d01d-40de-a24f-72caf1b0fef2 None None] MFA Rules not processed for user `6ed7c4911f0d40ad94b10b6ef4a75d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:48.515648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-22855450-d01d-40de-a24f-72caf1b0fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.543530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f695a4b3-05c0-4214-9685-189608e5dbf6 None None] MFA Rules not processed for user `c9bea8f2ddfa4b239bccc20506335e99`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:48.550479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f695a4b3-05c0-4214-9685-189608e5dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.645675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 819/1634] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:48.645675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd599015-85a1-45f4-a879-e60eda520e10 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.645675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd599015-85a1-45f4-a879-e60eda520e10 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.645675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd599015-85a1-45f4-a879-e60eda520e10 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.649777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 816/1635] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:48.651253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 820/1636] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 16 20:36:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:36:48.651554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8af9-11a8-4302-a7ba-41d0547b71db None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.652207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8af9-11a8-4302-a7ba-41d0547b71db None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.660363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd599015-85a1-45f4-a879-e60eda520e10 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.661023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8af9-11a8-4302-a7ba-41d0547b71db None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.665410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 817/1637] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 16 20:36:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:36:48.668619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.670043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.670381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.718726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:48.722977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.803777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd599015-85a1-45f4-a879-e60eda520e10 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.809687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.810603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.811069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.811714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.828620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.828620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffee35-1faa-4c0c-94b5-4e0b9092eb3b service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.830960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 818/1638] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:48.832687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.842855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 821/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:48.843507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657058a-7047-4dda-bfcd-74eee9d73afb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.845080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.845080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.845080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.849010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.849805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.850252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.850604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.861653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.863986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943257-e03c-42e8-b05b-e28f72db1d45 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.865247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:48.866711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.878122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 819/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:48.879959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22468-dc30-4f23-b76b-be86f477d0b7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.880533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22468-dc30-4f23-b76b-be86f477d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.880752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22468-dc30-4f23-b76b-be86f477d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.884112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 822/1641] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:48.915779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-72a22468-dc30-4f23-b76b-be86f477d0b7 None None] MFA Rules not processed for user `0f2fd6d77aa949d5b5919432cb722b37`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:48.917134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-72a22468-dc30-4f23-b76b-be86f477d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.952219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.964874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4181-660d-4e87-8bbf-ec556cd5bc4c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.977092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.977959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.978311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.978648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:49.001521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:49.005898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:49.031592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 823/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:36:49.090881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:49.099214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 820/1643] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:49.101206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:49.101536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:49.101900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:49.104305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce66ec5-dd2d-44a2-a885-58aa5097599a service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:49.113290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:49.114104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:49.114478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:49.114840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:49.132692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] MFA Rules not processed for user `0f2fd6d77aa949d5b5919432cb722b37`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:49.134470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:49.136008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:49.138770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:49.147414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 821/1644] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:49.159725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 824/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:36:49.736702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:49.752001 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e6f0f-2574-4ad3-bb14-3f20d8f7901e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:49.762591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:49.763509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:49.763801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:49.764079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:49.767339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:49.777442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9072-9844-4d41-ac15-eefc2d35dcd6 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:49.788596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:49.789275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:49.789564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:49.789838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:49.903674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:49.905762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de527b4-1403-427d-9f8c-7351756191cb service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:49.923847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:49.925763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:49.951905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 822/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:49.978647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 825/1647] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:36:50.216267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:50.242785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c558e1-585b-4a7a-8d5a-4e4327b49f0c service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:50.258705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:50.259381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:50.259667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:50.259932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:50.279973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:50.281656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7fddd-a919-4dfa-a7d5-b8abad084768 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:50.306618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 823/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:51.112247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea119b-b816-4a30-961f-e3bd75e70e71 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:51.114189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea119b-b816-4a30-961f-e3bd75e70e71 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:51.114700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea119b-b816-4a30-961f-e3bd75e70e71 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:51.116855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 826/1649] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 16 20:36:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:36:51.122207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:51.122786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:51.122786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:51.176752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:51.178419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:51.269800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 824/1650] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:51.282398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea119b-b816-4a30-961f-e3bd75e70e71 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:51.334094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea119b-b816-4a30-961f-e3bd75e70e71 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:51.340135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:51.341128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:51.341416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:51.341693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:51.368824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:51.370382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a731-1fda-443a-b009-958551c0699f service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:51.406187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 827/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:52.331800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:52.520140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f2177-35ef-4c79-9ff7-2e1fefe7d6c2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:52.533360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:52.535478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:52.536884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:52.537244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:52.587324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:52.591936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:52.605117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:52.628815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 825/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:56.087413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754350e-27ac-4dbb-9225-18e586ad175c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:56.088626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754350e-27ac-4dbb-9225-18e586ad175c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:56.089197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754350e-27ac-4dbb-9225-18e586ad175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:56.166841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1754350e-27ac-4dbb-9225-18e586ad175c None None] MFA Rules not processed for user `de3dd9262fba4830be6c4477628f2061`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:56.168258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1754350e-27ac-4dbb-9225-18e586ad175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:56.349392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 828/1653] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:56.406323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:56.432261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bc582-3ed4-4391-b7e2-816c985107c6 service placement] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:56.444082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:56.445312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:56.446009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:56.446507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:56.458631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:56.461466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:56.486545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 826/1654] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:56.492944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:56.493623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:56.494192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:56.546679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] MFA Rules not processed for user `b578680e88c741bda2c8e56b2dc9d335`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:56.548289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:56.637374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 829/1655] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:56.670191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:56.682935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02596-3961-4fc6-8a35-e9ece9c282d5 service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:56.698496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:56.699168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:56.699458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:56.699733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:56.736466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:56.738571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869c48a-4451-4021-93d9-830c886c3ba2 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:56.765360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 827/1656] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:58.474657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:58.566962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48526c8e-31e0-4bb4-bfa2-2154055bb452 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:58.572078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:58.574096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:58.574401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:58.574682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] PATH_INFO: `/v3/users/9429845a17224ee7930c907177886aad` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:58.576235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9429845a17224ee7930c907177886aad)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:58.578874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:58.652636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9429845a17224ee7930c907177886aad'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:58.653676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9429845a17224ee7930c907177886aad'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:58.678024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9429845a17224ee7930c907177886aad'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:58.689705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9429845a17224ee7930c907177886aad'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:58.708100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9429845a17224ee7930c907177886aad'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:58.719055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 830/1657] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:36:58 2022] DELETE /identity/v3/users/9429845a17224ee7930c907177886aad => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:58.724479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beac84-3b62-4a67-b6d2-249258b584af None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:58.725687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beac84-3b62-4a67-b6d2-249258b584af None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:58.726136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beac84-3b62-4a67-b6d2-249258b584af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:58.791599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-14beac84-3b62-4a67-b6d2-249258b584af None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:58.802307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-14beac84-3b62-4a67-b6d2-249258b584af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:58.952903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 828/1658] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:59.022090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:59.023646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:59.150277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6f099-15f6-45ae-a395-07f1e132b0df admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:59.158745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:59.159912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:59.160350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:59.160747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:59.175939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:59.178523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cbc2-a0aa-4d74-a169-f5dd45df4ff9 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:59.192481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 831/1659] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:36:59.436059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:59.436059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:59.436059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:59.470579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] MFA Rules not processed for user `b578680e88c741bda2c8e56b2dc9d335`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:59.473550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:59.561295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 829/1660] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:59.637991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cf2-b9b8-4440-b209-41793cc7a59c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:59.638421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cf2-b9b8-4440-b209-41793cc7a59c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:59.638502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6cf2-b9b8-4440-b209-41793cc7a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:59.706738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e03e6cf2-b9b8-4440-b209-41793cc7a59c None None] MFA Rules not processed for user `de3dd9262fba4830be6c4477628f2061`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:59.711595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e03e6cf2-b9b8-4440-b209-41793cc7a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:59.845189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 832/1661] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:59.933076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:59.935099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:59.968703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e9707-b22e-4734-bcd0-525d12e7fe1c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:59.989178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:59.990065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:59.990516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:59.991017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] PATH_INFO: `/v3/projects/3c936d9f5e7445a9829155fc6703a0f0` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:59.992393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c936d9f5e7445a9829155fc6703a0f0)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:59.995138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.088043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c936d9f5e7445a9829155fc6703a0f0', 'request_id': 'req-e82699e0-c94c-47e2-9040-216e406cc962'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:00.094562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c936d9f5e7445a9829155fc6703a0f0', 'request_id': 'req-e82699e0-c94c-47e2-9040-216e406cc962'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:00.108053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c936d9f5e7445a9829155fc6703a0f0', 'request_id': 'req-e82699e0-c94c-47e2-9040-216e406cc962'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:00.126426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] The token cache is being invalidate because project 3c936d9f5e7445a9829155fc6703a0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:00.127080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:00.127955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e82699e0-c94c-47e2-9040-216e406cc962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:00.135203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.135940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.136408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.138261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 830/1662] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:36:59 2022] DELETE /identity/v3/projects/3c936d9f5e7445a9829155fc6703a0f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:00.169163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:00.170938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:00.241187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 833/1663] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:00.249251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.249757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.250174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.276709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:00.278128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:00.287358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 831/1664] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:00.291916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.304302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b780a-08a2-41ad-873d-d030473845e6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.311180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.312029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.312411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.312831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.313787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:00.314254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.317824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e80257-2404-4473-b697-6789a12be7b0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.338266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 834/1665] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:00.338944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.352328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1aaa1-f5a5-49e6-90d8-18a6d4d5b080 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.365197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56fa5-cad8-4eef-b70e-472676b40e7e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.365746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56fa5-cad8-4eef-b70e-472676b40e7e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.367010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b56fa5-cad8-4eef-b70e-472676b40e7e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.369404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.370428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.370908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.371376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.374577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.374877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 835/1666] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 16 20:37:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:37:00.380157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.380830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.381121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.381402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.420240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 832/1667] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:00.421605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:00.423867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.425110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:00.510244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa68899-2b1b-46cd-8cb9-775f839cf805 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.521616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 836/1668] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:00.524663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.525288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.525572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.525847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.526565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.528688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.576720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 833/1669] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:00.582281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.601779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.604242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:00.609034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e061a-c20d-4d99-b208-fa73a0a01329 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.615506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.616152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.616793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.617173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.617949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.619700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.631256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430d9b-6b47-473f-a071-30c024bd9b0b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.643259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.645099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.645842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.647344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.651088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 837/1670] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:00.657694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.660186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.663263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.673758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 834/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:00.678317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dbf51-3b3b-4522-a91c-6826a1d7647e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.684764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.685505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.685787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.686217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.687093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.689125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030254-95db-4f61-b88e-8484342349f4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.701199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 838/1672] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:00.705956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:00.720326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f753-19a7-41cb-9d5f-e75482c6434a service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:00.732625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:00.733596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.733877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.734157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] PATH_INFO: `/v3/projects/9eb4804980364595913f8c7f732caa79/users/41350bcd1ad64022bd4a31ec1971ea69/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.756301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb4804980364595913f8c7f732caa79, user_id=41350bcd1ad64022bd4a31ec1971ea69, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:00.759260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:00.810328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 835/1673] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:00 2022] PUT /identity/v3/projects/9eb4804980364595913f8c7f732caa79/users/41350bcd1ad64022bd4a31ec1971ea69/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:00.820672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4909fa-a336-4012-906c-00b011376700 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:00.821316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4909fa-a336-4012-906c-00b011376700 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:00.821888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4909fa-a336-4012-906c-00b011376700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:00.896969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fe4909fa-a336-4012-906c-00b011376700 None None] MFA Rules not processed for user `41350bcd1ad64022bd4a31ec1971ea69`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:00.906598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fe4909fa-a336-4012-906c-00b011376700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:01.172545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 839/1674] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:01.174746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:01.317133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da777-0131-4d42-8216-4d9bf5eb880f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:01.352059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:01.352944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:01.353311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:01.355214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:01.356030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:01.359958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e048c-3776-4cd9-8428-cc1255d9c756 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:01.434462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 836/1675] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:01 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:01.439265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4909fa-a336-4012-906c-00b011376700 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:01.459907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4909fa-a336-4012-906c-00b011376700 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:01.623819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:01.624559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:01.624846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:01.625124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:01.625830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:01.644387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:01.654806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:01.655247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:01.655603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:01.694549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 840/1676] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:01 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:01.700217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:01.716656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:01.720471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:01.724067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebbcf5-51b6-49b5-9248-02b8a18dd188 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:01.736551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:01.737517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:01.737999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:01.738466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:01.741557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:01.744771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:01.775118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 841/1677] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:01.779135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:01.829942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e93e-e1c0-48df-aa9a-0804db2a0131 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:01.848793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:01.851134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:01.853366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:01.856188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] PATH_INFO: `/v3/projects/21412bad0d344d9eb1690767d32ad2ec/users/7fe3512ca8bd486fafb699260b41371f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:01.882469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 837/1678] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:37:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:01.901010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21412bad0d344d9eb1690767d32ad2ec, user_id=7fe3512ca8bd486fafb699260b41371f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:01.904638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:01.936109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 842/1679] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:01 2022] PUT /identity/v3/projects/21412bad0d344d9eb1690767d32ad2ec/users/7fe3512ca8bd486fafb699260b41371f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:01.940967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:01.960361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f26b-ca05-481c-a90b-9ff4f1ecd325 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:02.131304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:02.133370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:02.133666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:02.133945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:02.134802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:02.136683 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:02.171962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 838/1680] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:02.177100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:02.192895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcde00-d013-4755-8895-c6b0dce2e009 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:02.209188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:02.210976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:02.211422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:02.211681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] PATH_INFO: `/v3/projects/21412bad0d344d9eb1690767d32ad2ec/users/7fe3512ca8bd486fafb699260b41371f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:02.216094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21412bad0d344d9eb1690767d32ad2ec, user_id=7fe3512ca8bd486fafb699260b41371f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:02.222637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a682da-8bc7-4d3e-84f4-f0ec77858b72 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:02.239570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:02.243274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:02.274001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 843/1681] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:02 2022] PUT /identity/v3/projects/21412bad0d344d9eb1690767d32ad2ec/users/7fe3512ca8bd486fafb699260b41371f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:02.284329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88e56-b6e2-4239-b6d2-40f187cf917d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:02.284648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88e56-b6e2-4239-b6d2-40f187cf917d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:02.284928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88e56-b6e2-4239-b6d2-40f187cf917d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:02.364096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-73e88e56-b6e2-4239-b6d2-40f187cf917d None None] MFA Rules not processed for user `7fe3512ca8bd486fafb699260b41371f`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:02.365322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-73e88e56-b6e2-4239-b6d2-40f187cf917d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:02.428258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2c293-19ae-4326-8be5-521aa4719356 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:02.672330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:02.673073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:02.673513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:02.675040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:02.682821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 844/1682] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:02.863835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:02.867017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:02.903844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 839/1683] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:37:03.124865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:03.125753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:03.125753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:03.188056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:03.189343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:03.233480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:03.238126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:03.385362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 845/1684] 10.222.0.60 () {58 vars in 1015 bytes} [Mon May 16 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:03.411903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:03.413936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:03.435924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148c7c2-398f-49de-bb4b-056131e0ca6f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:03.454827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:03.458926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:03.459816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:03.460792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:03.479755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31bf5-98ab-4d8b-bbec-3bc06cc63fac service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:03.490993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:03.493091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:03.509574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:03.511747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:03.513695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:03.514232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:03.557122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 846/1685] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:03.558596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:03.563378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:03.572186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:03.576093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de839a-ff21-4646-b18a-443d24e9edc6 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:03.610136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 840/1686] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:03.714837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322a102-6d91-49fd-9fcf-fe0b5d437c46 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:03.728009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:03.729118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:03.729402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:03.729702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] PATH_INFO: `/v3/users/bd26cc840b9e480b890ca2c1f662ed4c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:03.731142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd26cc840b9e480b890ca2c1f662ed4c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:03.734188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:03.885236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd26cc840b9e480b890ca2c1f662ed4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:03.886331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd26cc840b9e480b890ca2c1f662ed4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:03.901548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd26cc840b9e480b890ca2c1f662ed4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:03.910634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd26cc840b9e480b890ca2c1f662ed4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:03.928219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd26cc840b9e480b890ca2c1f662ed4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:03.945644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 847/1687] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:03 2022] DELETE /identity/v3/users/bd26cc840b9e480b890ca2c1f662ed4c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:03.953508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:03.953508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:03.953508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:04.011874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:04.021279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:04.483328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:04.486311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:04.675775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d8db-85fc-40e5-bfd6-7e282c43030a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:04.685896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:04.694013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:04.695545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:04.698681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:04.713971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:04.715207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 841/1688] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 763 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:04.725136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:04.726774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:04.892509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb9be8-b586-42a4-be78-a94856a442ce None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:04.908407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:04.911067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:04.928185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:04.930154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:04.933550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:04.937464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:04.975325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 848/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:04.981822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:04.985462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d68df6-abb4-4bea-8c57-935d838147b9 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:05.047518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 842/1690] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:05.312904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:05.314656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:05.339540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da9583-f68c-4ae9-a8f7-cc54080afc97 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:05.355321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899819-6710-4139-936a-411728104871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:05.360368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899819-6710-4139-936a-411728104871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:05.360871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899819-6710-4139-936a-411728104871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:05.361227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899819-6710-4139-936a-411728104871 admin admin] PATH_INFO: `/v3/users/10f018886dcf4b6bb734867b239a6ca4` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:05.364816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899819-6710-4139-936a-411728104871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f018886dcf4b6bb734867b239a6ca4)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:05.371669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899819-6710-4139-936a-411728104871 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:05.572671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6899819-6710-4139-936a-411728104871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f018886dcf4b6bb734867b239a6ca4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:05.574146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6899819-6710-4139-936a-411728104871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f018886dcf4b6bb734867b239a6ca4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:05.628460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6899819-6710-4139-936a-411728104871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f018886dcf4b6bb734867b239a6ca4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:05.686200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6899819-6710-4139-936a-411728104871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f018886dcf4b6bb734867b239a6ca4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:05.719906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6899819-6710-4139-936a-411728104871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f018886dcf4b6bb734867b239a6ca4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:05.758110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:05.758999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:05.759533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:05.772080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 849/1691] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:05 2022] DELETE /identity/v3/users/10f018886dcf4b6bb734867b239a6ca4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:05.797789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:05.803106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:05.927239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 843/1692] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:05.980868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899819-6710-4139-936a-411728104871 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:05.982668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b6899819-6710-4139-936a-411728104871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:06.103465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899819-6710-4139-936a-411728104871 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:06.107760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:06.108713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.109215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.109614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.120828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:06.122554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:06.135489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 850/1693] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:06.322447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:06.324472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:06.338672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:06.340709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:06.350022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb822b5-397a-4b3b-8a97-710fc23dfa30 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:06.363192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:06.366504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.367034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.368187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704a60-390a-44a2-baa1-49002f2e3531 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:06.369515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] PATH_INFO: `/v3/users/bed9ae0ddd6646a29d9964a8b6289f56` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.372406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed9ae0ddd6646a29d9964a8b6289f56)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:06.376661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: WARNING py.warnings [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:37:06.376661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: warnings.warn(msg) May 16 20:37:06.376661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: May 16 20:37:06.379087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:06.382922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:06.383856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.384278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.384642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] PATH_INFO: `/v3/projects/ff2f097602f64521be30fcac0c86ca14` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.387258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2f097602f64521be30fcac0c86ca14)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:06.388312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:37:06.388312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 20:37:06.388312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: May 16 20:37:06.392253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:06.532630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2f097602f64521be30fcac0c86ca14', 'request_id': 'req-037d7444-5473-43e8-95d3-c975aa6d2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.546959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2f097602f64521be30fcac0c86ca14', 'request_id': 'req-037d7444-5473-43e8-95d3-c975aa6d2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.569081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2f097602f64521be30fcac0c86ca14', 'request_id': 'req-037d7444-5473-43e8-95d3-c975aa6d2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.607265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] The token cache is being invalidate because project ff2f097602f64521be30fcac0c86ca14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:06.607969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.608796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-037d7444-5473-43e8-95d3-c975aa6d2d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.615279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 851/1694] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:06 2022] DELETE /identity/v3/projects/ff2f097602f64521be30fcac0c86ca14 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:06.616982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee375c5-f7fa-4c80-a07a-f6e5ce33be43 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.617343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee375c5-f7fa-4c80-a07a-f6e5ce33be43 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.618219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee375c5-f7fa-4c80-a07a-f6e5ce33be43 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.620568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 852/1695] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:37:06.621445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa07b-69d5-4bb5-ab26-1c848971e49f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.621850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa07b-69d5-4bb5-ab26-1c848971e49f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.622201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa07b-69d5-4bb5-ab26-1c848971e49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.628871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed9ae0ddd6646a29d9964a8b6289f56'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.663136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3c2fa07b-69d5-4bb5-ab26-1c848971e49f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:06.663862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c2fa07b-69d5-4bb5-ab26-1c848971e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:06.695087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed9ae0ddd6646a29d9964a8b6289f56'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.733319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed9ae0ddd6646a29d9964a8b6289f56'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.748478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed9ae0ddd6646a29d9964a8b6289f56'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.775049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d19844f9-8603-4bf2-b38b-1aa1b82eff7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed9ae0ddd6646a29d9964a8b6289f56'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:06.804109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 844/1696] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:06 2022] DELETE /identity/v3/users/bed9ae0ddd6646a29d9964a8b6289f56 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:06.805892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.808082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.808582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.841147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 853/1697] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:06.842690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31138cc-fb7b-46ba-8dff-d52ccfea12e0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:06.851758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31138cc-fb7b-46ba-8dff-d52ccfea12e0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:06.852530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31138cc-fb7b-46ba-8dff-d52ccfea12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:06.881629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:06.887073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:06.893808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b31138cc-fb7b-46ba-8dff-d52ccfea12e0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:06.897897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b31138cc-fb7b-46ba-8dff-d52ccfea12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.070512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 854/1698] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:07.072357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.073839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.074202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.092936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 845/1699] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:07.110149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:07.112036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.123242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.125366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.145401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 855/1700] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:07.148863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.182136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a63380-1e1d-4bb0-9b46-caffa7d9de0b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.198117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.200733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.201157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.202295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.206472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:07.206792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.214086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.274201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 856/1701] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:07.274201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.274622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b6ae-daff-4e0d-b4ec-6874ec9919ba None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.278275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.280744 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.281547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.281906 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.282684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.297333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.299726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.344772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 846/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:07.344772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.344772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.346113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4848-2ac0-4c65-80dc-bd4428485bc8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.369564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.371644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.371934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.376751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.406007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.408104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e38c6-c9cc-4d5b-ae4c-b6624c5215ff service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.409953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.422468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.425521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.434684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.435020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] PATH_INFO: `/v3/projects/5c71264673cd46288ae1e42a5f9e0875` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.435704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 857/1703] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:07.436723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.438440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c71264673cd46288ae1e42a5f9e0875)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.448205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.458395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f00f-790c-49d6-9b2f-1481126a30ff service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.470098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.472689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.473039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.473906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.475856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.480713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.555588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 858/1704] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:07.558936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.582983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c71264673cd46288ae1e42a5f9e0875', 'request_id': 'req-a9751bea-2e57-4c77-8e46-211a0737283a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:07.599661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c71264673cd46288ae1e42a5f9e0875', 'request_id': 'req-a9751bea-2e57-4c77-8e46-211a0737283a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:07.618616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c71264673cd46288ae1e42a5f9e0875', 'request_id': 'req-a9751bea-2e57-4c77-8e46-211a0737283a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:07.684374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] The token cache is being invalidate because project 5c71264673cd46288ae1e42a5f9e0875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:07.685353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:07.687073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a9751bea-2e57-4c77-8e46-211a0737283a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:07.690684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 847/1705] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:07 2022] DELETE /identity/v3/projects/5c71264673cd46288ae1e42a5f9e0875 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:07.696254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7759-bfed-4a7d-9c30-9bcb568b242c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.698527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7759-bfed-4a7d-9c30-9bcb568b242c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.699025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7759-bfed-4a7d-9c30-9bcb568b242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.722637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956141-dedd-45c0-ba73-046cd3e318ae admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.729006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.730030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.730491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.730981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.731966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.734680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.746712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c59a7759-bfed-4a7d-9c30-9bcb568b242c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:07.749153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c59a7759-bfed-4a7d-9c30-9bcb568b242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.767821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 859/1706] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:07.772011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.774238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.786244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 848/1707] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:07.797177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.797724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.798221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.800666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104d17-4dff-498f-8754-897756a1d94e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.808830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.810455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.810806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.811209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.812013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.814040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.822367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:07.824696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:07.827391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 860/1708] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:07.831123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.843441 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee78f-2ad3-4b81-aa77-dd2743413f97 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.849755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.850585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.850941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.851472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.852429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.854360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.867741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 861/1709] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:07.872367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.885765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dabd4-4688-4387-a192-9e6e2135335f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.891936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:07.893212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.893641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.894070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] PATH_INFO: `/v3/projects/07285fd0cbcf409b8d2f950ba33a2bbb/users/565c2491176c4b7e8f0cc6820399ba3f/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:07.902139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 849/1710] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:07.905222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:07.916500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07285fd0cbcf409b8d2f950ba33a2bbb, user_id=565c2491176c4b7e8f0cc6820399ba3f, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:07.919622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690be12a-21a7-447b-b012-0c469cd9a1b9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:07.947416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20c9f4-0bbf-4782-8d73-ee55c15c8886 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:07.954095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 862/1711] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:07 2022] PUT /identity/v3/projects/07285fd0cbcf409b8d2f950ba33a2bbb/users/565c2491176c4b7e8f0cc6820399ba3f/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:07.967000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:07.967555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:07.968290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.045844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] MFA Rules not processed for user `565c2491176c4b7e8f0cc6820399ba3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:08.047385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:08.128731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.129538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.129921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.130294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.132381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:08.134496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.136662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.174431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 850/1712] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:08.176951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.206521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1e63-4cd3-44e3-982f-7c8d94f8e7fc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:08.209861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 863/1713] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:08.210879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.222981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe4f59-72ec-43a8-861a-f1b373d59716 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:08.231125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.231798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.232119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.232458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.235075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.237645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.250616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.251295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.251817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.251922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.252789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.255767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.311577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 851/1714] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:08 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:08.316482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.337922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 864/1715] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:08 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:08.339110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.494253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddce5-c57e-4e13-b597-9c76944f7aa5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:08.534586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593840a-04fd-4918-bf51-2db622426b9e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:08.540811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.540811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.540811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.540811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.541897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.544048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.577347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 865/1716] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:08 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:08.578493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.580758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:08.600747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ad9e-6980-4529-b20a-64ed6e79a63d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:08.613670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.614673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.615410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.615782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] PATH_INFO: `/v3/projects/00607ca0863848d6b887ad9c198ddf50` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.619171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00607ca0863848d6b887ad9c198ddf50)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.620186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.724342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00607ca0863848d6b887ad9c198ddf50', 'request_id': 'req-4caea711-fc93-417a-b381-0f4dde0a7f12'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:08.747933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00607ca0863848d6b887ad9c198ddf50', 'request_id': 'req-4caea711-fc93-417a-b381-0f4dde0a7f12'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:08.776899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00607ca0863848d6b887ad9c198ddf50', 'request_id': 'req-4caea711-fc93-417a-b381-0f4dde0a7f12'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:08.804942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:08.805532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] The token cache is being invalidate because project 00607ca0863848d6b887ad9c198ddf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:08.805532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:08.805739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:08.805937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:08.806221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:08.813162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:08.814377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:08.823564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:08.824688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 866/1717] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:08 2022] DELETE /identity/v3/projects/00607ca0863848d6b887ad9c198ddf50 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:08.826382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.843579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:08.916267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 852/1718] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:08 2022] POST /identity/v3/users => generated 288 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:08.917052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:08.926991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:08.953708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb30f0-4171-4648-a884-27a280a4b9b5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.089440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea711-fc93-417a-b381-0f4dde0a7f12 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.094799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.098988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.099353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.099697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.100590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.104045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.141666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 867/1719] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:09.141666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.141666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.172871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.176854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.177366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.177916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] PATH_INFO: `/v3/users/6ed7c4911f0d40ad94b10b6ef4a75d7b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.200932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed7c4911f0d40ad94b10b6ef4a75d7b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.203850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dfaf0-0bc0-421f-8952-69662c3bbc21 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.217675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.228838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.229752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.230473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.231252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.233580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.237200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.279943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 868/1720] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:09.285257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.314751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394899e4-b0c3-4a58-af16-2530d123e9a4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.333224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.334349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.334628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.334905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] PATH_INFO: `/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e/users/0a6db795052a4f448a6ebdf61df1f82f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.365323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed7c4911f0d40ad94b10b6ef4a75d7b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:09.385185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed7c4911f0d40ad94b10b6ef4a75d7b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:09.389584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1263b4328241db8e5b1a9ef028ec9e, user_id=0a6db795052a4f448a6ebdf61df1f82f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.392623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.407056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed7c4911f0d40ad94b10b6ef4a75d7b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:09.408628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed7c4911f0d40ad94b10b6ef4a75d7b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:09.437615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 869/1721] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:09 2022] PUT /identity/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e/users/0a6db795052a4f448a6ebdf61df1f82f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:09.438590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.439615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed7c4911f0d40ad94b10b6ef4a75d7b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:09.454266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.459840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 853/1722] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:08 2022] DELETE /identity/v3/users/6ed7c4911f0d40ad94b10b6ef4a75d7b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:09.460865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.462663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.607382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ebdc-4e1d-4a2c-8ff2-beb45191a420 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.615375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.616097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.616402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.616730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.617473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.619275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.619376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea548be-b12e-45fa-a1d2-e98e806e1a21 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.626472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.627659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.628020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.628300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.629970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.631954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.643391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 870/1723] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:09.649002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.671104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 854/1724] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:09.675611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596b3a-c983-40ed-9cf6-2a4266763c30 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.677720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.685463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.686388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.686671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.686949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] PATH_INFO: `/v3/projects/19972a48759f4069a2c855f9f7f829e4/users/8feec28b3f09416facb89d4a5a77d0a5/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.691395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0f09-3190-4180-8ab4-594c7ef5b5ba admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:09.696875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:09.698018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.699122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.699547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] PATH_INFO: `/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e/users/0a6db795052a4f448a6ebdf61df1f82f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.703210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1263b4328241db8e5b1a9ef028ec9e, user_id=0a6db795052a4f448a6ebdf61df1f82f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.706110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3ebbe-3e3e-4ec0-9d6f-86ec2dd47fa2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.730435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19972a48759f4069a2c855f9f7f829e4, user_id=8feec28b3f09416facb89d4a5a77d0a5, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:09.733912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a45f1-0a9d-42d6-a42c-1f06dd3a1b6e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:09.757600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 855/1725] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:09 2022] PUT /identity/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e/users/0a6db795052a4f448a6ebdf61df1f82f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:09.761420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.761745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.762038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.764972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 871/1726] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:09 2022] PUT /identity/v3/projects/19972a48759f4069a2c855f9f7f829e4/users/8feec28b3f09416facb89d4a5a77d0a5/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:09.776283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:09.776835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:09.777295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:09.815574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] MFA Rules not processed for user `0a6db795052a4f448a6ebdf61df1f82f`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:09.817633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.850583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] MFA Rules not processed for user `8feec28b3f09416facb89d4a5a77d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:09.851848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.912890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 856/1727] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:09.928799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:09.932793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:09.977303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 872/1728] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:10.011872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8bd3b-86ba-4fa1-8421-1c8891cad811 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:10.016582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:10.017326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:10.017828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:10.018143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:10.033981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:10.035728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:10.048930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 857/1729] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:10.129848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:10.131402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:10.268484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5044c4b-dce1-4a3a-93d8-e4368f041083 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:10.279837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:10.285792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:10.286128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:10.286401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:10.298483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:10.300385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72b8cf-39ba-4cb2-8828-c26a14dac040 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:10.318840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 873/1730] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:10.900482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:11.017254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd85b-11b9-4bc1-9e48-fdf1a028dd75 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:11.029414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:11.030470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.030897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.031182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] PATH_INFO: `/v3/users/8feec28b3f09416facb89d4a5a77d0a5` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:11.032422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8feec28b3f09416facb89d4a5a77d0a5)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:11.034615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:11.123020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8feec28b3f09416facb89d4a5a77d0a5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.169449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8feec28b3f09416facb89d4a5a77d0a5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.181314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8feec28b3f09416facb89d4a5a77d0a5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.183931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8feec28b3f09416facb89d4a5a77d0a5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.211843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8feec28b3f09416facb89d4a5a77d0a5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.259171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 858/1731] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:10 2022] DELETE /identity/v3/users/8feec28b3f09416facb89d4a5a77d0a5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:11.263406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.264274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.264711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:11.314895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:11.316990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:11.412925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 874/1732] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:11.424688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:11.432431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:11.493490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560b262-b814-47c5-98d1-620f90352b03 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:11.502237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:11.503002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.503286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.503563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:11.513393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:11.514859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a3278-49ae-456b-b4ae-85ba643cd97d service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:11.528600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 859/1733] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:11.544518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:11.546336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:11.578986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee650f-eed6-442a-a7e4-692251cc011d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:11.600568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:11.601476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.601760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.602031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] PATH_INFO: `/v3/projects/f836579993384d6e8d8e99ee4627e3a8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:11.603330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] RBAC: Authorizing `identity:delete_project(project_id=f836579993384d6e8d8e99ee4627e3a8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:11.605322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:11.733643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f836579993384d6e8d8e99ee4627e3a8', 'request_id': 'req-81f17646-6d0b-4f6c-8250-f5ad62d592da'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.749673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f836579993384d6e8d8e99ee4627e3a8', 'request_id': 'req-81f17646-6d0b-4f6c-8250-f5ad62d592da'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.769930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f836579993384d6e8d8e99ee4627e3a8', 'request_id': 'req-81f17646-6d0b-4f6c-8250-f5ad62d592da'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.794106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] The token cache is being invalidate because project f836579993384d6e8d8e99ee4627e3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:11.794392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.796877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81f17646-6d0b-4f6c-8250-f5ad62d592da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:11.799831 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 875/1734] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:11 2022] DELETE /identity/v3/projects/f836579993384d6e8d8e99ee4627e3a8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:11.808299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.808717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.809047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:11.834946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:11.834946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:11.969149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 860/1735] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:11.977399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:11.977785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:11.978337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.005166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:12.016478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:12.019577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 876/1736] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:12.025562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.037937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a573a9-c6fc-4893-8b92-6ca4ea527782 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.046443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.050120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.051361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.051759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.053163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:12.053474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.055161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.083370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 861/1737] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:12.089279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.102099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f1b7-9066-4e67-82a8-b1500f628f8d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.108868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.109598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.109846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.110109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.111485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.113739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.186315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 877/1738] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:12 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:12.190842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.212457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d55b-8a55-4007-be47-6b5f3432fc37 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.356368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.357108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.357389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.357669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.358369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.365271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2ae9-9d67-4a3a-9e07-27b71bc7ebd8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.416187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 862/1739] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:12 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:12.421262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.442710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1e77-9bd7-4d7e-9933-6b0ce27eac9e None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.443543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1e77-9bd7-4d7e-9933-6b0ce27eac9e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.443543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1e77-9bd7-4d7e-9933-6b0ce27eac9e None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.445779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 863/1740] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:37:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:37:12.450611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d890-512b-4137-8d1c-7d8fb0e3fa98 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.466933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.468357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.468876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.469206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cfeb5-a7c2-41ec-962d-3cead720201a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.469507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cfeb5-a7c2-41ec-962d-3cead720201a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.469767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.469866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cfeb5-a7c2-41ec-962d-3cead720201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.471019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.473093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.539428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-546cfeb5-a7c2-41ec-962d-3cead720201a None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:12.546731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-546cfeb5-a7c2-41ec-962d-3cead720201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:12.565839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 878/1741] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:12.568571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.597016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad25a-38c8-4787-b7ab-06b0d3d415cd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.619463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.620138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.620630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.620927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.621648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.625044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.685966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 879/1742] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:12.687215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.736056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae9110-b4c0-4a74-b3c0-0ca753fb104d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:12.763108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:12.764841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.766078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.766605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] PATH_INFO: `/v3/projects/04a7d2cdd33e4128855dd51937ef16fd/users/58aabc489e0947a8a4379d945c1cfd71/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.805416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a7d2cdd33e4128855dd51937ef16fd, user_id=58aabc489e0947a8a4379d945c1cfd71, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:12.806055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 864/1743] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:12.822836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:12.859297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 880/1744] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:12 2022] PUT /identity/v3/projects/04a7d2cdd33e4128855dd51937ef16fd/users/58aabc489e0947a8a4379d945c1cfd71/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:12.871943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:12.872633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:12.873080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:12.935518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:12.937339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:12.967411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] MFA Rules not processed for user `58aabc489e0947a8a4379d945c1cfd71`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:12.968751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:13.164860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699202-7b06-4b64-ae40-278417802dd4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:13.189496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 865/1745] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:13.190354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:13.215656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:13.218355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:13.219300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc995d6-0e9a-4ec0-8668-28ad741db5a2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:13.220957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:13.221551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] PATH_INFO: `/v3/projects/19972a48759f4069a2c855f9f7f829e4` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:13.226270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19972a48759f4069a2c855f9f7f829e4)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:13.228929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:13.229955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:13.233890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:13.234246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:13.234522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:13.236058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:13.242941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:13.312498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 866/1746] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:13 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:13.313703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:13.316605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:13.419695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19972a48759f4069a2c855f9f7f829e4', 'request_id': 'req-2eb2d873-5529-4923-975d-eaebc84c5227'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.432012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19972a48759f4069a2c855f9f7f829e4', 'request_id': 'req-2eb2d873-5529-4923-975d-eaebc84c5227'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.455462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163799f-5dcd-406d-a815-8dd7654b5674 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:13.460712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19972a48759f4069a2c855f9f7f829e4', 'request_id': 'req-2eb2d873-5529-4923-975d-eaebc84c5227'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.535518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] The token cache is being invalidate because project 19972a48759f4069a2c855f9f7f829e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:13.537967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.539601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.545087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 881/1747] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:12 2022] DELETE /identity/v3/projects/19972a48759f4069a2c855f9f7f829e4 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:13.546180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:13.552650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:13.634386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:13.635287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:13.635567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:13.635842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] PATH_INFO: `/v3/users/565c2491176c4b7e8f0cc6820399ba3f` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:13.640708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=565c2491176c4b7e8f0cc6820399ba3f)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:13.643079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:13.736986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d873-5529-4923-975d-eaebc84c5227 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:13.746622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565c2491176c4b7e8f0cc6820399ba3f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.761388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:13.763579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:13.766931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:13.767370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:13.768280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:13.770479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb5e34-e6f7-4828-9218-df636daf8e1d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:13.786640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565c2491176c4b7e8f0cc6820399ba3f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.810572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565c2491176c4b7e8f0cc6820399ba3f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.813879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565c2491176c4b7e8f0cc6820399ba3f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.832715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 882/1748] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:13 2022] POST /identity/v3/users => generated 303 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:13.834669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:13.835176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:13.841506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:13.842223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565c2491176c4b7e8f0cc6820399ba3f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:13.867890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 867/1749] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:13 2022] DELETE /identity/v3/users/565c2491176c4b7e8f0cc6820399ba3f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:13.867890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:13.870884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:13.921956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:13.923287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.070202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f5664-48f0-4792-b5f6-bef2cd3de85d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.079484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 883/1750] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:14.087798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.091468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.092161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.092516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.092868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.094882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.099788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.119081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765218c6-f47e-4b8f-a504-4fcfa33578c9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.125984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.127259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.128144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dbc25-ab48-425b-b5a3-d886a0414a67 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.129104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.129601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.130173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.131239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.133403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0f4be-b40a-4ffc-91ef-449e48b8118b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.141421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 868/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:14.143008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.143603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.143889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.170220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:14.170637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 884/1752] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:14.170733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.170819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.170819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.170819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.179653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 869/1753] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:14.184730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.197580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faccd06-a8f7-42f4-b39f-ba22a00dcb36 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.205953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.207240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.207715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.208130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] PATH_INFO: `/v3/projects/b600fce646f34bed80bdc9c0c80e6c91/users/5af5b159e3f142fb8f48a4fd29d74b37/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.228185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b600fce646f34bed80bdc9c0c80e6c91, user_id=5af5b159e3f142fb8f48a4fd29d74b37, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.231735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.247283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:14.250140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.259905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 870/1754] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:14 2022] PUT /identity/v3/projects/b600fce646f34bed80bdc9c0c80e6c91/users/5af5b159e3f142fb8f48a4fd29d74b37/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:14.261399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.271526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.397665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 885/1755] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:14.399353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.416984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e0cd5-9aa0-45fa-93fd-1f31800c88c0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.422538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.423292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.423723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.424006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.432849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24015562-76fa-4e45-8f26-f5f313211e14 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.437524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.438220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.438491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.438977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.439873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.441853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.446814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.453340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.457946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 886/1756] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:14.459088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.470262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473017b8-f03c-48e1-93a2-0395008afe36 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.476927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.477535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 871/1757] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:14.478143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.478779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.479480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.480908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.481263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:14.481760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.483824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.502783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035d89-fba9-460c-8bfa-f78cd5bf8e6c service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.505608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 887/1758] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:14.509713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.518321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.519595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.520011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.520419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] PATH_INFO: `/v3/projects/b600fce646f34bed80bdc9c0c80e6c91/users/5af5b159e3f142fb8f48a4fd29d74b37/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.521986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c83a5c-e1f9-4a82-ab21-1c536e47aeee admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.522853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b600fce646f34bed80bdc9c0c80e6c91, user_id=5af5b159e3f142fb8f48a4fd29d74b37, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.525983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74124a-1dec-469b-ba1c-a25877f08a79 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.526805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.527603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.527947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.528287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.529072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.531104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.544067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 872/1759] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:14 2022] PUT /identity/v3/projects/b600fce646f34bed80bdc9c0c80e6c91/users/5af5b159e3f142fb8f48a4fd29d74b37/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:14.556915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.557276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.557500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.567251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 888/1760] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:14 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:14.571265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.607605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] MFA Rules not processed for user `5af5b159e3f142fb8f48a4fd29d74b37`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:14.609835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.712301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c87b8-7d88-4fc9-91f6-b72dbb5bb164 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.724520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.726108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.727054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.728395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.729977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.734035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.764483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 873/1761] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:14.778333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.780843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:14.792129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 889/1762] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:14 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:14.797170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.817816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e8d3-f7ac-4ce3-975b-e30e748a475b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.832828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.833718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.834069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.834406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.835213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.838860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.865343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 890/1763] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:14.872223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.896360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59605a96-226d-4e62-a419-3f281f83d5b9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.910841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.913268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.914421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.914950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.917239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2867279-9677-4cd4-8af8-48b8a74f026d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:14.918115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.919858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.932650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:14.933532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:14.934028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:14.934479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:14.965913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 891/1764] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:14.969281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:14.983120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:14.987415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43457f2-8506-482e-8a3a-c756a403853d service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:14.997947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30d0c3-6da1-4a2a-958b-382210cb356b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:15.011097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:15.011349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 874/1765] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:15.012542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.013274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.014176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] PATH_INFO: `/v3/projects/bb82c34f2cf24cb0b88ed2e4775f83a8/users/140a5fa54c1e44fe9b0e29c5b00a79a0/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.031601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb82c34f2cf24cb0b88ed2e4775f83a8, user_id=140a5fa54c1e44fe9b0e29c5b00a79a0, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:15.035079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:15.061968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 892/1766] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:14 2022] PUT /identity/v3/projects/bb82c34f2cf24cb0b88ed2e4775f83a8/users/140a5fa54c1e44fe9b0e29c5b00a79a0/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:15.084190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.084587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.084975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.135256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:15.161856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] MFA Rules not processed for user `140a5fa54c1e44fe9b0e29c5b00a79a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:15.163194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:15.312226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b052bb-ca8c-4b99-85e7-13a3a201762e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:15.316422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:15.320741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.320986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.321267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.328728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 875/1767] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:15.329768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:15.334335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:15.499173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f5bb-31ce-4b35-8a2d-1fb322e69572 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:15.506023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:15.506692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.506971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.507243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.507939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:15.510164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:15.531709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:15.533487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:15.547614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 893/1768] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:15.549156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:15.550772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:15.566996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 876/1769] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:15 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:15.567822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:15.571117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b546663-9f9a-4dd8-8636-88354c4c759d service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:15.572143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:15.666078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:15.667118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.667571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.667726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] PATH_INFO: `/v3/users/41350bcd1ad64022bd4a31ec1971ea69` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.669259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41350bcd1ad64022bd4a31ec1971ea69)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:15.671372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:15.749476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eff97-0355-4f5f-88ae-52f0566be611 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:15.761388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:15.763060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:15.764487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:15.765705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] PATH_INFO: `/v3/projects/07285fd0cbcf409b8d2f950ba33a2bbb` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:15.768892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07285fd0cbcf409b8d2f950ba33a2bbb)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:15.771388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41350bcd1ad64022bd4a31ec1971ea69'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.774380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:15.782511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41350bcd1ad64022bd4a31ec1971ea69'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.840883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41350bcd1ad64022bd4a31ec1971ea69'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.870200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41350bcd1ad64022bd4a31ec1971ea69'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.897782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07285fd0cbcf409b8d2f950ba33a2bbb', 'request_id': 'req-be4ce2e9-61e1-42de-a39f-28f975acba18'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.901946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41350bcd1ad64022bd4a31ec1971ea69'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.913344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 894/1770] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:15 2022] DELETE /identity/v3/users/41350bcd1ad64022bd4a31ec1971ea69 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:15.916028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:15.920701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:15.925767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07285fd0cbcf409b8d2f950ba33a2bbb', 'request_id': 'req-be4ce2e9-61e1-42de-a39f-28f975acba18'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:15.946608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07285fd0cbcf409b8d2f950ba33a2bbb', 'request_id': 'req-be4ce2e9-61e1-42de-a39f-28f975acba18'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.000134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] The token cache is being invalidate because project 07285fd0cbcf409b8d2f950ba33a2bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:16.004425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.007502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-be4ce2e9-61e1-42de-a39f-28f975acba18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.017632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 877/1771] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:15 2022] DELETE /identity/v3/projects/07285fd0cbcf409b8d2f950ba33a2bbb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:16.021298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.026113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.027246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.091674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:16.093758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:16.201405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 878/1772] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:16.202401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.206476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:16.219161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3470f6-b5e7-4544-a3ad-1dc5284ffbd5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.229471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.230420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.230895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.231374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.233566 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.235880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.263920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b221e3-906e-4739-8153-384d3d037e1e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.272395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.273208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.273482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.273770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] PATH_INFO: `/v3/users/0a6db795052a4f448a6ebdf61df1f82f` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.275420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6db795052a4f448a6ebdf61df1f82f)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.277410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.284047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 895/1773] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:15 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:16.284695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.290794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:16.368512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6db795052a4f448a6ebdf61df1f82f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.395135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6db795052a4f448a6ebdf61df1f82f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.415642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6db795052a4f448a6ebdf61df1f82f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.418678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6db795052a4f448a6ebdf61df1f82f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.434023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6db795052a4f448a6ebdf61df1f82f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:16.445795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 879/1774] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:16 2022] DELETE /identity/v3/users/0a6db795052a4f448a6ebdf61df1f82f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:16.445795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.445795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:16.480212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42667-eb8f-4367-a5a9-1faee3b3fbdb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.553455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.554163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.556967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.557284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.560079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:16.617513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f35eb-0cd8-4ed6-8a93-3fd218bd6c83 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.626354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.627172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.627554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.627892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.629081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.632592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.643796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 880/1775] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:16.647876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.658378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f730-7a76-42d9-a736-ca7762e35021 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.663898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.664826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.665104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.665379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] PATH_INFO: `/v3/projects/5387c1ebad474154a56d9d911400fc69/users/39525cfab1c9441b9a048554d77aa32e/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.678501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.680463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.681041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5387c1ebad474154a56d9d911400fc69, user_id=39525cfab1c9441b9a048554d77aa32e, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.683700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.691956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 896/1776] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:16.698401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 881/1777] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:16 2022] PUT /identity/v3/projects/5387c1ebad474154a56d9d911400fc69/users/39525cfab1c9441b9a048554d77aa32e/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:16.702434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.712300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ff877-e77a-4ade-acbe-9facde08ec93 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.791153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.791880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.792399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.792766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.793893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.795436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78af6-5df0-464d-a425-c2c9a24fab21 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.810744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 897/1778] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:16.811714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:16.824393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36d955-3ec5-46a4-8beb-ca18f7af0296 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:16.829331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:16.830363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.830645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.831082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] PATH_INFO: `/v3/projects/5387c1ebad474154a56d9d911400fc69/users/39525cfab1c9441b9a048554d77aa32e/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.833134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5387c1ebad474154a56d9d911400fc69, user_id=39525cfab1c9441b9a048554d77aa32e, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:16.835781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:16.856051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 882/1779] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:16 2022] PUT /identity/v3/projects/5387c1ebad474154a56d9d911400fc69/users/39525cfab1c9441b9a048554d77aa32e/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:16.870406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:16.870902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:16.871251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:16.912567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] MFA Rules not processed for user `39525cfab1c9441b9a048554d77aa32e`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:16.914019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.013493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 898/1780] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:17.024122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.026783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.121310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703899b-d841-4f10-8237-cacc5963a77b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.127947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.127947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.127947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.127947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.128986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.130504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.139394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.140928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.153425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 883/1781] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:17.200796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.203219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.239297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b19340-9650-429c-9f69-ad3cf2a7575f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.245121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.246216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.246693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.247063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] PATH_INFO: `/v3/projects/9eb4804980364595913f8c7f732caa79` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.248396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb4804980364595913f8c7f732caa79)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.250967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.302992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c82624-71f5-496b-8636-9fc9a1f46a79 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.323555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb4804980364595913f8c7f732caa79', 'request_id': 'req-86018509-5ddd-4db5-8d0b-407601697ae9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.329215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb4804980364595913f8c7f732caa79', 'request_id': 'req-86018509-5ddd-4db5-8d0b-407601697ae9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.340453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb4804980364595913f8c7f732caa79', 'request_id': 'req-86018509-5ddd-4db5-8d0b-407601697ae9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.360924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] The token cache is being invalidate because project 9eb4804980364595913f8c7f732caa79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:17.363189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.365096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.371241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 899/1782] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:17 2022] DELETE /identity/v3/projects/9eb4804980364595913f8c7f732caa79 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:17.372288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.374008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.388069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.389000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.389279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.389554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] PATH_INFO: `/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.391331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1263b4328241db8e5b1a9ef028ec9e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.393676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.456673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1263b4328241db8e5b1a9ef028ec9e', 'request_id': 'req-9012bfaa-edf2-469d-8119-e7bfd77755ea'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.462085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1263b4328241db8e5b1a9ef028ec9e', 'request_id': 'req-9012bfaa-edf2-469d-8119-e7bfd77755ea'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.473735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1263b4328241db8e5b1a9ef028ec9e', 'request_id': 'req-9012bfaa-edf2-469d-8119-e7bfd77755ea'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.482011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018509-5ddd-4db5-8d0b-407601697ae9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.491854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] The token cache is being invalidate because project 9d1263b4328241db8e5b1a9ef028ec9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:17.492371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.493060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9012bfaa-edf2-469d-8119-e7bfd77755ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.498917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 884/1783] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:17 2022] DELETE /identity/v3/projects/9d1263b4328241db8e5b1a9ef028ec9e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:17.500889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea3418-21b1-407c-9f16-f22a0a955d44 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.501120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea3418-21b1-407c-9f16-f22a0a955d44 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.501435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea3418-21b1-407c-9f16-f22a0a955d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.523768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2ea3418-21b1-407c-9f16-f22a0a955d44 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:17.525010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2ea3418-21b1-407c-9f16-f22a0a955d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.571544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.572642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.572971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.573309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] PATH_INFO: `/v3/users/7fe3512ca8bd486fafb699260b41371f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.574602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe3512ca8bd486fafb699260b41371f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.577055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.611475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 885/1784] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:17.613604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.614100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.614620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.638428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:17.640051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.650240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 886/1785] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:17.651374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.654057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.659517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe3512ca8bd486fafb699260b41371f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.660918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe3512ca8bd486fafb699260b41371f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.670782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923554c-fee9-4651-88f4-5a17e3debaae None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.676053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.676197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe3512ca8bd486fafb699260b41371f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.676974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.677258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.677913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] PATH_INFO: `/v3/users/140a5fa54c1e44fe9b0e29c5b00a79a0` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.679572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140a5fa54c1e44fe9b0e29c5b00a79a0)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.681679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.684002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe3512ca8bd486fafb699260b41371f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.692640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe3512ca8bd486fafb699260b41371f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.698683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 900/1786] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:17 2022] DELETE /identity/v3/users/7fe3512ca8bd486fafb699260b41371f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:17.701830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.701830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.735138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140a5fa54c1e44fe9b0e29c5b00a79a0'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.755867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140a5fa54c1e44fe9b0e29c5b00a79a0'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.766080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140a5fa54c1e44fe9b0e29c5b00a79a0'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.766819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140a5fa54c1e44fe9b0e29c5b00a79a0'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.771266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207166-bef0-4bb8-a55c-39ee15a37a8c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.776476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.776978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.777221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.777487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.778368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:17.778661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.780407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cae6-1488-4f44-bcc9-8dd8109fd13c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.787851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140a5fa54c1e44fe9b0e29c5b00a79a0'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:17.800532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 887/1787] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:17 2022] DELETE /identity/v3/users/140a5fa54c1e44fe9b0e29c5b00a79a0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:17.800850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 901/1788] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:17.804108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.805617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.806135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.806426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.806766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.827902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:17.829163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:17.920780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8a25-e5ca-4440-92ea-3ca5effcb153 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:17.929019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:17.929723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:17.932210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:17.932461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:17.933293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:17.935277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:17.946077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 902/1789] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:17.980240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:17.982426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.001121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 888/1790] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:17 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:18.005636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.152192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83265f45-6c45-4a92-8a64-7b110921736f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.161564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.161564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.161564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.161816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.170027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd074015-958d-4dc4-8112-c620fbfaa0b4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.171365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.179419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.226223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 889/1791] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:18.228125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.234034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.256893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ea08-e89f-4554-a8df-81b71099c8c2 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.271991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.272915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.273961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.273961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] PATH_INFO: `/v3/projects/21412bad0d344d9eb1690767d32ad2ec` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.274931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21412bad0d344d9eb1690767d32ad2ec)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.278594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.291099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.292008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.292528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.292994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.320542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.322017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.333663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 903/1792] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:18.334428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.344380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae314ab-11b6-4efe-b34b-c59ed358ee09 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.378804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21412bad0d344d9eb1690767d32ad2ec', 'request_id': 'req-6a71c56b-bbb6-459f-a572-62380281744c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.385784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21412bad0d344d9eb1690767d32ad2ec', 'request_id': 'req-6a71c56b-bbb6-459f-a572-62380281744c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.395594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21412bad0d344d9eb1690767d32ad2ec', 'request_id': 'req-6a71c56b-bbb6-459f-a572-62380281744c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.414175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] The token cache is being invalidate because project 21412bad0d344d9eb1690767d32ad2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:18.414565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.415519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a71c56b-bbb6-459f-a572-62380281744c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.418216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 890/1793] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:18 2022] DELETE /identity/v3/projects/21412bad0d344d9eb1690767d32ad2ec => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:18.422803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4142-dd2e-4608-a1a5-b94e5d0a9f47 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.423094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4142-dd2e-4608-a1a5-b94e5d0a9f47 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.423403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4142-dd2e-4608-a1a5-b94e5d0a9f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.444169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324239-db96-4e24-9351-835627537407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.446062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324239-db96-4e24-9351-835627537407 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.446351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324239-db96-4e24-9351-835627537407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.446630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324239-db96-4e24-9351-835627537407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.449488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa324239-db96-4e24-9351-835627537407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.453070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa324239-db96-4e24-9351-835627537407 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.465442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-342d4142-dd2e-4608-a1a5-b94e5d0a9f47 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:18.466361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-342d4142-dd2e-4608-a1a5-b94e5d0a9f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.473892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 904/1794] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:18.478890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324239-db96-4e24-9351-835627537407 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.481121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-aa324239-db96-4e24-9351-835627537407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.494012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324239-db96-4e24-9351-835627537407 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.495868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 891/1795] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:18.504606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.504915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.505177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.506198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.506920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.507209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.507574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.508290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.510057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.523368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 905/1796] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:18.535080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:18.536504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.537019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.547533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 892/1797] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:18.551996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.564108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe97ac-aff6-4eee-ba0d-b82c3d67d977 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.570027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f74b63-32f3-499c-930c-a8c4131538bf None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.571943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.572951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.573363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.573740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] PATH_INFO: `/v3/projects/acc01cd1b50746fdba9014a12a02b381/users/00bc480b2db946f291c6f61e59bc279a/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.576315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.577993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.577993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.577993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.578446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:18.578623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.580347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.598087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc01cd1b50746fdba9014a12a02b381, user_id=00bc480b2db946f291c6f61e59bc279a, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.601109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c447-104a-46e2-9f20-09a3f4d6ddc7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.611100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 893/1798] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:18.612062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.635997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a25f-3199-4577-84c2-eb7be14b6bc0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.641576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 906/1799] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:18 2022] PUT /identity/v3/projects/acc01cd1b50746fdba9014a12a02b381/users/00bc480b2db946f291c6f61e59bc279a/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:18.643851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.644198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.644465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.685522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] MFA Rules not processed for user `00bc480b2db946f291c6f61e59bc279a`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:18.686742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.720065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.720857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.721279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.722386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.722386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.724647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.753684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 894/1800] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:18.757625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.765828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 907/1801] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:18.770690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.783885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dc39b-f5cb-4b81-82d2-39aed73bb341 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.838854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09211d3-6e67-48fa-90b1-633bf7aa059f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.844182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.844976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.845258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.845578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.846457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.848422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.850823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.851495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.851784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.852067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.852819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.854751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.873986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 895/1802] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:18.873986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.873986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:18.887170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 908/1803] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:18.887796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956342-1b24-4a07-b3e9-cabaa9524aa3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.888451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.942203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.943108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.943399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.943667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] PATH_INFO: `/v3/projects/bb82c34f2cf24cb0b88ed2e4775f83a8` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.945435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb82c34f2cf24cb0b88ed2e4775f83a8)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.947472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.949493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ccf00-4771-45c5-8a35-1786002c206c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.954212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.954875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.955148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.955409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.956168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.957861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.967894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 909/1804] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:18.968709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:18.978503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc4ce-dba6-4ea3-8705-d06083ed9fb8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:18.983414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:18.984069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:18.984348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:18.984636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:18.985304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:18.987392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:18.993318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb82c34f2cf24cb0b88ed2e4775f83a8', 'request_id': 'req-ddc7dab0-3a41-4557-be2f-bcad18b329b4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:18.999094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb82c34f2cf24cb0b88ed2e4775f83a8', 'request_id': 'req-ddc7dab0-3a41-4557-be2f-bcad18b329b4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.006194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb82c34f2cf24cb0b88ed2e4775f83a8', 'request_id': 'req-ddc7dab0-3a41-4557-be2f-bcad18b329b4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.008865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 910/1805] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:18 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:19.009680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.017580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] The token cache is being invalidate because project bb82c34f2cf24cb0b88ed2e4775f83a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:19.017869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.018603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.019265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fbb95-04ef-473c-a0a1-e0a033bd2a7c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.020165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 896/1806] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:18 2022] DELETE /identity/v3/projects/bb82c34f2cf24cb0b88ed2e4775f83a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.020945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.022210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.075101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.076431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.076773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.077198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.078073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.079883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.083475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dab0-3a41-4557-be2f-bcad18b329b4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.088328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.089025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.089302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.089569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.090290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.094399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 911/1807] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:19.094525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.094602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.095683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.102121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 897/1808] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:19.102758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.104325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.110537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f45e6-c167-4dcd-adb2-2e746d119438 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.115438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.116314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.116621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.116874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5420-0950-46fb-b0fd-bb530b32e9bb admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.116986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] PATH_INFO: `/v3/users/39525cfab1c9441b9a048554d77aa32e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.118056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39525cfab1c9441b9a048554d77aa32e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.120016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.122326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.123218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.123509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.123806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] PATH_INFO: `/v3/projects/a6c089512f0440d585c333c83eef97e1/users/7005338ea7c640f59e1a74eadfb1735e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.138740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c089512f0440d585c333c83eef97e1, user_id=7005338ea7c640f59e1a74eadfb1735e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.141627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.154553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 898/1809] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:19 2022] PUT /identity/v3/projects/a6c089512f0440d585c333c83eef97e1/users/7005338ea7c640f59e1a74eadfb1735e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.155404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.174593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39525cfab1c9441b9a048554d77aa32e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.175372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39525cfab1c9441b9a048554d77aa32e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.187196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39525cfab1c9441b9a048554d77aa32e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.194387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39525cfab1c9441b9a048554d77aa32e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.201938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf2a7811-7f6f-4bcb-bac5-7697762c7025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39525cfab1c9441b9a048554d77aa32e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.210651 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 912/1810] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:19 2022] DELETE /identity/v3/users/39525cfab1c9441b9a048554d77aa32e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.212239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.212622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.212898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.218798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfaac-e84c-42c5-913f-d0efe136ea75 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.242576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] MFA Rules not processed for user `7005338ea7c640f59e1a74eadfb1735e`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:19.243797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.277620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.278521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.278807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.280729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] PATH_INFO: `/v3/projects/2ee7d4c53a61454f94ac3398439bce27/users/ce67245da5d1466e9e44429007a0a919/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.298346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee7d4c53a61454f94ac3398439bce27, user_id=ce67245da5d1466e9e44429007a0a919, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.301417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.316481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 913/1811] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:19.325969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.328004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.330836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 899/1812] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:19 2022] PUT /identity/v3/projects/2ee7d4c53a61454f94ac3398439bce27/users/ce67245da5d1466e9e44429007a0a919/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.334299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.336216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.345990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60019-9d80-4a68-b043-d5620ba9bc71 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.431372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.432209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.432519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.432800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.433609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.436724 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.489507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 914/1813] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:19 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:19.489853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.494276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e2b-1030-49b6-ae07-39941b451bdd admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.566039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3bac-46fb-4745-8612-8a3159102d43 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.570327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.571253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.571690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.572218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.573131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.573621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.573936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.574302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.574691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.575201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.577438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.578144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.597104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 900/1814] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:19.600545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.612347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b88e5-57c3-421b-879f-903776f8da67 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.614498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 915/1815] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:19 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:19.618024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.622412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.623415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.623701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.623984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] PATH_INFO: `/v3/projects/2ee7d4c53a61454f94ac3398439bce27/users/ce67245da5d1466e9e44429007a0a919/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.625377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.633070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee7d4c53a61454f94ac3398439bce27, user_id=ce67245da5d1466e9e44429007a0a919, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.636471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.650531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 901/1816] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:19 2022] PUT /identity/v3/projects/2ee7d4c53a61454f94ac3398439bce27/users/ce67245da5d1466e9e44429007a0a919/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.651647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.662219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cda55-d53c-40a5-a4db-47ea328a3a02 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.726494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2b927-6c8c-48ca-a7ae-db38ae9211cd admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.731545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.732298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.732702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.733035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.733957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.735653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae11e72-f8a2-4687-8b7e-266b8dea91f3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.744305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.745531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.745760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.746101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] PATH_INFO: `/v3/projects/5387c1ebad474154a56d9d911400fc69` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.747891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5387c1ebad474154a56d9d911400fc69)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.749088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 902/1817] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:19.750472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65685-7fe6-419b-8a29-d1d1835fa501 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.750829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65685-7fe6-419b-8a29-d1d1835fa501 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.751021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65685-7fe6-419b-8a29-d1d1835fa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.753419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.778955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-efb65685-7fe6-419b-8a29-d1d1835fa501 None None] MFA Rules not processed for user `ce67245da5d1466e9e44429007a0a919`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:19.780182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-efb65685-7fe6-419b-8a29-d1d1835fa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.827012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5387c1ebad474154a56d9d911400fc69', 'request_id': 'req-00ae0060-5874-478b-b135-86e4a047424c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.833948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5387c1ebad474154a56d9d911400fc69', 'request_id': 'req-00ae0060-5874-478b-b135-86e4a047424c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.847650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5387c1ebad474154a56d9d911400fc69', 'request_id': 'req-00ae0060-5874-478b-b135-86e4a047424c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.860610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] The token cache is being invalidate because project 5387c1ebad474154a56d9d911400fc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:19.861487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.862143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:19.864275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 916/1818] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:19 2022] DELETE /identity/v3/projects/5387c1ebad474154a56d9d911400fc69 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.865083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.868694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.874832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 903/1819] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:19.875937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.876243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.876688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.900338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:19.902248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.949646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae0060-5874-478b-b135-86e4a047424c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.954467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.955358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.955634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.955903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] PATH_INFO: `/v3/projects/83bc343a33f5469b8fd92c1cc0f31258/users/98f73c006c1340bb904e2e3d1942f3bd/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.964145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 904/1820] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:19.965041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.966556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.970097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bc343a33f5469b8fd92c1cc0f31258, user_id=98f73c006c1340bb904e2e3d1942f3bd, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.973040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:19.978277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf1385-863d-4e78-b77d-ab6a0544d7d8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:19.983466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:19.984765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:19.985053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:19.985333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] PATH_INFO: `/v3/users/58aabc489e0947a8a4379d945c1cfd71` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:19.986410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 917/1821] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:19 2022] PUT /identity/v3/projects/83bc343a33f5469b8fd92c1cc0f31258/users/98f73c006c1340bb904e2e3d1942f3bd/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:19.986527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aabc489e0947a8a4379d945c1cfd71)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:19.987196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:19.988741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:19.988843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.034354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aabc489e0947a8a4379d945c1cfd71'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:20.045218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603251-4617-434a-af37-d112cbdc4391 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.045448 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aabc489e0947a8a4379d945c1cfd71'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:20.049078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.049732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.050076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.050355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.052183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.054241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aabc489e0947a8a4379d945c1cfd71'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:20.055411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aabc489e0947a8a4379d945c1cfd71'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:20.064992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0c2f79b1-b2b1-4af6-be6d-0e145341f934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aabc489e0947a8a4379d945c1cfd71'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:20.072036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 905/1822] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:19 2022] DELETE /identity/v3/users/58aabc489e0947a8a4379d945c1cfd71 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:20.073535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ee56-9724-453c-9812-7ca28c63f510 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.073824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ee56-9724-453c-9812-7ca28c63f510 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.074250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ee56-9724-453c-9812-7ca28c63f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.093741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4fc6ee56-9724-453c-9812-7ca28c63f510 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:20.094865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4fc6ee56-9724-453c-9812-7ca28c63f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.121227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.122513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.132368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 918/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:20.133054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.158117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 906/1824] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:20.159516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.159807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.160086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.179107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:20.180350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.189721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 907/1825] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:20.190453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.208729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc724d0-1dcc-4065-ab51-1dfe99376e31 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.213578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.214254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.214538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.214809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.215543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:20.215850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.217495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.218510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e583-2f62-4d7d-8ca0-afb38d62617b service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.223918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.224878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.225331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.225916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.227093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.229882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 908/1826] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:20.230012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.230722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.237127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.244115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 919/1827] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:20.245044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.255964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6bbc-4967-48c1-99bc-413634492958 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.262346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.263347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.263837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.264291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.265191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.267643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.306964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 920/1828] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/projects => generated 355 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:20.307938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.310093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.311882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d091-4f91-484d-aa0e-e86c26ba8b04 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.369833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.371427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.371957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.372628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.387399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.389341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.394035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6099c-32af-4562-ba72-ec89a2f78167 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.403228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 909/1829] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:20.404163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.404663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.405635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.405919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.406192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] PATH_INFO: `/v3/projects/83bc343a33f5469b8fd92c1cc0f31258/users/98f73c006c1340bb904e2e3d1942f3bd/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.409852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bc343a33f5469b8fd92c1cc0f31258, user_id=98f73c006c1340bb904e2e3d1942f3bd, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.412937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a015c40-febe-442d-8aa2-15c574e5b5d9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.423652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730846e-cff4-45b1-94ee-c79ff517786b service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.437939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 921/1830] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:20 2022] PUT /identity/v3/projects/83bc343a33f5469b8fd92c1cc0f31258/users/98f73c006c1340bb904e2e3d1942f3bd/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:20.440106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.440487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.440870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.481576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] MFA Rules not processed for user `98f73c006c1340bb904e2e3d1942f3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:20.483112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.543057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.543798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.543998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.544662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.546103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.548145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.576812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 922/1831] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:20.586766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 910/1832] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/users => generated 278 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:20.587583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.603912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f96d3-530c-4f76-8c82-1d4e0f063d4e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.606537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.608531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.650643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.651348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.651617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.651903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.652684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.661632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.686833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 923/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:20.687920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.693308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:20.731305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad56a91-480b-4c70-a334-38cf6fd890e4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.736581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce67245da5d1466e9e44429007a0a919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee7d4c53a61454f94ac3398439bce27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.737849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.737849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.738626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.739785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:20.740186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.741922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.759031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 911/1834] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:37:20.762392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.779409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595e06-d440-452a-86fc-897ad9e50d95 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.790161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.793858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.794239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.794730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.796353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.798319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.817784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 912/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:20.819018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.831955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e2f5b-fb73-45d7-91c1-3ef1eb6ffcf3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.837857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d584-c098-4fa5-8cb6-52f783a065b1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:20.846050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce67245da5d1466e9e44429007a0a919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee7d4c53a61454f94ac3398439bce27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.846218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:20.846750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.847069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.847347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.847835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:20.848184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:20.848805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:20.849626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.851620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.874810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:20.876277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:20.897412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 924/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:20.902726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 913/1837] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:20 2022] POST /identity/v3/projects => generated 355 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:20.906755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.906893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:20.932282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616afa-d64e-45d0-a75f-0668d861b1a1 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.011749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a2d0-1e44-49fb-803a-715cc22009c2 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.035046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce67245da5d1466e9e44429007a0a919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee7d4c53a61454f94ac3398439bce27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.035753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.036261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.036716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.037613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:21.037920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.041043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e6d11-5151-422a-8c12-be9d87f181a6 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.097475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.099110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.099889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.100477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] PATH_INFO: `/v3/projects/c8ef749701ca456ca2f6bd8abc5dce5c/users/31e451616b7c487d83894e12f7a98021/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.141124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 914/1838] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:21.159546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ef749701ca456ca2f6bd8abc5dce5c, user_id=31e451616b7c487d83894e12f7a98021, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.165300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.204517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 925/1839] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:20 2022] PUT /identity/v3/projects/c8ef749701ca456ca2f6bd8abc5dce5c/users/31e451616b7c487d83894e12f7a98021/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:21.218633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.218633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.218633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.221730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.230150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.292127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] MFA Rules not processed for user `31e451616b7c487d83894e12f7a98021`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:21.294823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.377891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550928-a064-4695-ac3f-5c33b55a8fda admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.384796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.386145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.386732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.386953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] PATH_INFO: `/v3/projects/04a7d2cdd33e4128855dd51937ef16fd` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.388577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a7d2cdd33e4128855dd51937ef16fd)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.390680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.393650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 915/1840] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:21 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:21.394573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.443837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a7d2cdd33e4128855dd51937ef16fd', 'request_id': 'req-ffdca600-bdb8-4115-ba83-43d8f2836ce7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.449237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a7d2cdd33e4128855dd51937ef16fd', 'request_id': 'req-ffdca600-bdb8-4115-ba83-43d8f2836ce7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.458910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a7d2cdd33e4128855dd51937ef16fd', 'request_id': 'req-ffdca600-bdb8-4115-ba83-43d8f2836ce7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.472540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] The token cache is being invalidate because project 04a7d2cdd33e4128855dd51937ef16fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:21.472894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.473687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.474483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd7fbd-ba91-470e-855d-75141cc4fb0c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.475697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 926/1841] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:21 2022] DELETE /identity/v3/projects/04a7d2cdd33e4128855dd51937ef16fd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:21.476222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.477815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.532323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce67245da5d1466e9e44429007a0a919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee7d4c53a61454f94ac3398439bce27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.533520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.533873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.534236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] PATH_INFO: `/v3/projects/383d39ba87dd461b955c1fdd03ea7c42` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.535567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=383d39ba87dd461b955c1fdd03ea7c42)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.537790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.553740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca600-bdb8-4115-ba83-43d8f2836ce7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.558549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.559859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.560480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.560617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.561337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.563424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.587074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383d39ba87dd461b955c1fdd03ea7c42', 'request_id': 'req-541635cf-86bd-4d79-9bbd-94cc3efec024'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.591433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 927/1842] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:21 2022] POST /identity/v3/projects => generated 355 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:21.592457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.594014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.595659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383d39ba87dd461b955c1fdd03ea7c42', 'request_id': 'req-541635cf-86bd-4d79-9bbd-94cc3efec024'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.602985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383d39ba87dd461b955c1fdd03ea7c42', 'request_id': 'req-541635cf-86bd-4d79-9bbd-94cc3efec024'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.614311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] The token cache is being invalidate because project 383d39ba87dd461b955c1fdd03ea7c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:21.614597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.615331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.616935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 916/1843] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:21 2022] DELETE /identity/v3/projects/383d39ba87dd461b955c1fdd03ea7c42 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:21.617781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.619031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.666180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22dd8e-4ccb-4000-b9d2-94a263f92acd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.671337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.672340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.672826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.673074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] PATH_INFO: `/v3/users/5af5b159e3f142fb8f48a4fd29d74b37` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.674286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af5b159e3f142fb8f48a4fd29d74b37)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.676399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.687137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541635cf-86bd-4d79-9bbd-94cc3efec024 tempest-VolumeQuotaClassesTest-1744497284 tempest-VolumeQuotaClassesTest-1744497284-project-admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.691926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.693047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.693349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.693628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] PATH_INFO: `/v3/users/7005338ea7c640f59e1a74eadfb1735e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.694980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7005338ea7c640f59e1a74eadfb1735e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.697348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.727206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af5b159e3f142fb8f48a4fd29d74b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.727907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af5b159e3f142fb8f48a4fd29d74b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.739690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af5b159e3f142fb8f48a4fd29d74b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.747418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af5b159e3f142fb8f48a4fd29d74b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.755681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af5b159e3f142fb8f48a4fd29d74b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.757275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7005338ea7c640f59e1a74eadfb1735e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.765331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 928/1844] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:21 2022] DELETE /identity/v3/users/5af5b159e3f142fb8f48a4fd29d74b37 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:21.765331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.765331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.780761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7005338ea7c640f59e1a74eadfb1735e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.797293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7005338ea7c640f59e1a74eadfb1735e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.798213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7005338ea7c640f59e1a74eadfb1735e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.809056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8066dced-c7a4-4c38-a9c8-5c4ebb5ea22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7005338ea7c640f59e1a74eadfb1735e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:21.820777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 917/1845] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:21 2022] DELETE /identity/v3/users/7005338ea7c640f59e1a74eadfb1735e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:21.822408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.822755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.823013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.844957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:21.846161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.853321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f50e9f-8006-4f24-bdfa-76ddc7436c87 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.912518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.913120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.913401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.915863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 918/1846] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:21.916711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.917314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.918778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.918894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.921300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.931703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd62c-2b37-4bdd-89f4-d6adf8c5fe6c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:21.937218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:21.938313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:21.938476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:21.938630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] PATH_INFO: `/v3/users/00bc480b2db946f291c6f61e59bc279a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:21.939959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00bc480b2db946f291c6f61e59bc279a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:21.942006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:21.951263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 929/1847] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:21 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:21.952115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:21.953933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:21.995861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00bc480b2db946f291c6f61e59bc279a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.009147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00bc480b2db946f291c6f61e59bc279a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.015047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7951e40-3fe1-421d-8683-4d983120f447 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.016414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00bc480b2db946f291c6f61e59bc279a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.017164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00bc480b2db946f291c6f61e59bc279a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.018996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.019656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.019948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.020223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.022617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.032147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00bc480b2db946f291c6f61e59bc279a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.038801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.039489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 919/1848] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:21 2022] DELETE /identity/v3/users/00bc480b2db946f291c6f61e59bc279a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.040290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.040424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746550-b074-4046-9d2e-fb0353c04a2a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.043491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.052635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 930/1849] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:22.052880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.053442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.053716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.071894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:22.073168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.112859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f515886-cf7a-490f-b64e-b034838fea88 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.118508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.119581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.120008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.120422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.121752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.123371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.135386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 920/1850] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:22.138701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.141095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.145087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 931/1851] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:22.145941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.155825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b121e99-226a-4af9-aabc-1c2a8bc5b3f1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.156798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765a5a-cac7-42d8-8502-e72a0bac98fa admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.161784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.162874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.163101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.163218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.163470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] PATH_INFO: `/v3/projects/827b4377def546388e1a14c493713df5/users/c2be7dcdfa22498face0af91c71200d0/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.164037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.164336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.164637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] PATH_INFO: `/v3/projects/b600fce646f34bed80bdc9c0c80e6c91` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.165867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b600fce646f34bed80bdc9c0c80e6c91)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.167782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.180598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827b4377def546388e1a14c493713df5, user_id=c2be7dcdfa22498face0af91c71200d0, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.183306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.216864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 932/1852] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:22 2022] PUT /identity/v3/projects/827b4377def546388e1a14c493713df5/users/c2be7dcdfa22498face0af91c71200d0/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.218047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.221205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.227283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b600fce646f34bed80bdc9c0c80e6c91', 'request_id': 'req-6f04d016-d02c-452d-aecc-6c254fe949e8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.235414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b600fce646f34bed80bdc9c0c80e6c91', 'request_id': 'req-6f04d016-d02c-452d-aecc-6c254fe949e8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.256000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b600fce646f34bed80bdc9c0c80e6c91', 'request_id': 'req-6f04d016-d02c-452d-aecc-6c254fe949e8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.274070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] The token cache is being invalidate because project b600fce646f34bed80bdc9c0c80e6c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:22.274390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.275692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.281690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 921/1853] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:22 2022] DELETE /identity/v3/projects/b600fce646f34bed80bdc9c0c80e6c91 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.283183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.284681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.325805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5ac1-3157-4e3a-8961-11bf47f6fb90 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.393299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.400817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04d016-d02c-452d-aecc-6c254fe949e8 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.400910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.402273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.402581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.405433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.406140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.406619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.406900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.407306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.407641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.409585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b02e4-a4db-4e97-98a0-35c0cf23bc90 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.427642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 922/1854] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:22.431280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.432795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.433071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.433221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.433613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.445887 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 933/1855] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:22.446568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.453074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:22.454353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.455972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.462850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 923/1856] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:22.463671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.472802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100ec7-8d1f-446e-b947-408c8935b372 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.473198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764cf67-c3d8-4f09-bca7-7adfa7279cfe None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.477822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.477959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.478714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.478824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.478991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.479094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.479242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] PATH_INFO: `/v3/projects/827b4377def546388e1a14c493713df5/users/c2be7dcdfa22498face0af91c71200d0/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.479334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] PATH_INFO: `/v3/projects/a6c089512f0440d585c333c83eef97e1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.480470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c089512f0440d585c333c83eef97e1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.481287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827b4377def546388e1a14c493713df5, user_id=c2be7dcdfa22498face0af91c71200d0, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.482571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.484040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64c433-ff5e-4c1f-9f1c-168102416d29 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.504076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 924/1857] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:22 2022] PUT /identity/v3/projects/827b4377def546388e1a14c493713df5/users/c2be7dcdfa22498face0af91c71200d0/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.505584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.505870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.506143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.549381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:22.550857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.562326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c089512f0440d585c333c83eef97e1', 'request_id': 'req-b441caee-0beb-43ad-ad33-871ba1949bbe'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.568195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c089512f0440d585c333c83eef97e1', 'request_id': 'req-b441caee-0beb-43ad-ad33-871ba1949bbe'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.576123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c089512f0440d585c333c83eef97e1', 'request_id': 'req-b441caee-0beb-43ad-ad33-871ba1949bbe'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.589295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] The token cache is being invalidate because project a6c089512f0440d585c333c83eef97e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:22.589597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.590605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b441caee-0beb-43ad-ad33-871ba1949bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.595139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 934/1858] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:22 2022] DELETE /identity/v3/projects/a6c089512f0440d585c333c83eef97e1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.595139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.595139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.595139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.629665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 925/1859] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:22.630219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] MFA Rules not processed for user `c2be7dcdfa22498face0af91c71200d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:22.630316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.630399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.632070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.645164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499585b-3201-435f-b110-388a6f43ec3a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.650774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.651793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.652087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.652362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] PATH_INFO: `/v3/users/98f73c006c1340bb904e2e3d1942f3bd` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.660525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f73c006c1340bb904e2e3d1942f3bd)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.662903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.723373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 935/1860] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:22.724627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.744615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f73c006c1340bb904e2e3d1942f3bd'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.746907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333380-93b8-4768-a548-1c70e27ac355 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.751782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.752715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.753000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.753309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.754089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:22.754393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.756019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.757416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f73c006c1340bb904e2e3d1942f3bd'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.765158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f73c006c1340bb904e2e3d1942f3bd'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.765954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f73c006c1340bb904e2e3d1942f3bd'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.768935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 936/1861] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:22.770006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.771676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.780265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f73c006c1340bb904e2e3d1942f3bd'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:22.787737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 926/1862] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:22 2022] DELETE /identity/v3/users/98f73c006c1340bb904e2e3d1942f3bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:22.789273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.797655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.840999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72672824-5de9-4406-a2e9-2f4a223fdce8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.889766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2edab-680f-4798-a6e6-1cc24014201e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:22.896176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.896867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.897079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:22.897214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.897404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.898215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:22.898526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:22.898873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:22.899574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.899762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.902015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.932959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 927/1863] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:22.934151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.936018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:22.972715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:22.974606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:22.985777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 937/1864] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:22 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:22.986669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:22.997097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61bcb0-2667-472b-aed5-e8d04dab9985 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.015533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8bba9-6844-42f8-9e15-1614df956e41 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.021771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.023387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.023771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.024144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] PATH_INFO: `/v3/projects/acc01cd1b50746fdba9014a12a02b381` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.026169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc01cd1b50746fdba9014a12a02b381)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.028675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.085832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.086588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.086928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.087263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.088200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.090771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.117490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc01cd1b50746fdba9014a12a02b381', 'request_id': 'req-6cae7e21-06d7-448d-b01b-568a11b4e785'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.125025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 938/1865] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:22 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:23.126396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.128199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.131357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc01cd1b50746fdba9014a12a02b381', 'request_id': 'req-6cae7e21-06d7-448d-b01b-568a11b4e785'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.142437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc01cd1b50746fdba9014a12a02b381', 'request_id': 'req-6cae7e21-06d7-448d-b01b-568a11b4e785'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.142556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0527bd-15ee-43bd-941a-11d32ddaa585 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.157084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] The token cache is being invalidate because project acc01cd1b50746fdba9014a12a02b381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:23.157380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.158059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.159873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 928/1866] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:22 2022] DELETE /identity/v3/projects/acc01cd1b50746fdba9014a12a02b381 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:23.163584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.165450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.210308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.211221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.211501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.211777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] PATH_INFO: `/v3/projects/83bc343a33f5469b8fd92c1cc0f31258` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.213027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bc343a33f5469b8fd92c1cc0f31258)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.215090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.232279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae7e21-06d7-448d-b01b-568a11b4e785 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.237918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.238646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.239074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.239356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.240245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.242226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.253099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 929/1867] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:23.253968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.255698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.263118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bc343a33f5469b8fd92c1cc0f31258', 'request_id': 'req-9eb4af58-a862-42b8-aaf0-bf9c574da066'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.268162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa28d9-f6c3-4a3b-b585-72de17921124 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.268540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bc343a33f5469b8fd92c1cc0f31258', 'request_id': 'req-9eb4af58-a862-42b8-aaf0-bf9c574da066'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.276874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bc343a33f5469b8fd92c1cc0f31258', 'request_id': 'req-9eb4af58-a862-42b8-aaf0-bf9c574da066'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.287815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] The token cache is being invalidate because project 83bc343a33f5469b8fd92c1cc0f31258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:23.288094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.288746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.290290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 939/1868] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:23 2022] DELETE /identity/v3/projects/83bc343a33f5469b8fd92c1cc0f31258 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:23.291042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.292300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.324320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.325232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.325508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.325779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] PATH_INFO: `/v3/users/ce67245da5d1466e9e44429007a0a919` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.326974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce67245da5d1466e9e44429007a0a919)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.328919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.346542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4af58-a862-42b8-aaf0-bf9c574da066 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.351540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.352546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.352757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.353140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.355523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.379759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce67245da5d1466e9e44429007a0a919'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.391449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce67245da5d1466e9e44429007a0a919'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.401625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce67245da5d1466e9e44429007a0a919'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.402451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce67245da5d1466e9e44429007a0a919'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.410824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce67245da5d1466e9e44429007a0a919'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:23.417585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 930/1869] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:23 2022] DELETE /identity/v3/users/ce67245da5d1466e9e44429007a0a919 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:23.418460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.418953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.419871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.420466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152257-a19b-4e3f-9c23-017c964e9312 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.430335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 940/1870] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:23.431648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809afd0-a689-4233-b2ac-66f73371097c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.431941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809afd0-a689-4233-b2ac-66f73371097c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.432379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809afd0-a689-4233-b2ac-66f73371097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.451630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6809afd0-a689-4233-b2ac-66f73371097c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:23.453412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6809afd0-a689-4233-b2ac-66f73371097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.500967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870778-0d50-4556-ac57-0ea835c3d800 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.520260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.521207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.521503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.522392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.523149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.525606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.527531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 941/1871] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:23.538860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.540064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.540727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.541699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 931/1872] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:23.545805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.564107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:23.565349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.566835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a09-27ad-4a78-86dc-462bb405c15a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.574024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 942/1873] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:23.578600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.579698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.580952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.588869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.588988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a630f6-c9ec-4620-88c5-eb4b8ea3c12a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.589218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] PATH_INFO: `/v3/projects/dc8d47208d774973a54e404479b2e942/users/a119b50f39c543fca7ce4a1f0e966a1d/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.604617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.606067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.606355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.606624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.607365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:23.611505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.613213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.627136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8d47208d774973a54e404479b2e942, user_id=a119b50f39c543fca7ce4a1f0e966a1d, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.630035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342effe-bfd7-4f69-b2d4-b0dd5cf49ad4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.637155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 943/1874] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:23.646182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.662925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad641dc-fcfe-4dbd-b08e-f94c6c205479 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.673168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 932/1875] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:23 2022] PUT /identity/v3/projects/dc8d47208d774973a54e404479b2e942/users/a119b50f39c543fca7ce4a1f0e966a1d/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:23.684358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.684986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.685215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.685309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.685542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.685677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.685902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.686673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.688969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.731408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] MFA Rules not processed for user `a119b50f39c543fca7ce4a1f0e966a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:23.733064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:23.752479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 944/1876] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:23.756957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.803594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 933/1877] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:23.807988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.821134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8975-0c78-4824-bb8a-7f28b66eb7f3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.825895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.826636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.827160 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.827294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.828124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.830184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.869569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 945/1878] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:23.870840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.883112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0118c2-7e4c-4348-90e1-a86fc1c953e5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.888869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.889545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.889905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.890112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.890817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.892583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.903644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab40d-c5a4-4124-97eb-b6392e32b749 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.904360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 946/1879] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:23.908558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.910265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.910964 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.911303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.911591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.912317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.914648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.924655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b88ae-275f-49c3-a855-19268d19cd7c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:23.931519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:23.932797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:23.932797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:23.933002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:23.933950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:23.936608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:23.954266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 947/1880] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:23.956998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 934/1881] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:23.958875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.959178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:23.971964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbb853-8203-4f02-86c6-3081d05603cb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.035970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a271-14d8-4676-bb07-630adcb9150a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.042295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.043210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.043490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.043760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] PATH_INFO: `/v3/projects/0e090872c166451096d16e66ceb33f74/users/a7f5a95c229a4d2ebf386cd7ce35165b/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.045314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.046088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.046385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.046718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.047669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.049367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.059109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e090872c166451096d16e66ceb33f74, user_id=a7f5a95c229a4d2ebf386cd7ce35165b, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.062178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.074724 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 948/1882] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:23 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:24.077846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.077846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.078261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 935/1883] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:23 2022] PUT /identity/v3/projects/0e090872c166451096d16e66ceb33f74/users/a7f5a95c229a4d2ebf386cd7ce35165b/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:24.079345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.093494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0daf3-9175-4735-95dd-88ef1edba71a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.138918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aee48-caf4-4061-91c1-ab59d565c41b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.144174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.144878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.145132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.145408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.146144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.147748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ac7f3-731e-4c70-954b-1506a375de39 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.148922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.149823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.150108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.150381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] PATH_INFO: `/v3/projects/2ee7d4c53a61454f94ac3398439bce27` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.151572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee7d4c53a61454f94ac3398439bce27)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.153525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.157888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 936/1884] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:24.159309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ca6a-c5bd-4f30-bb37-3f9e4eaf6de8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.159778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ca6a-c5bd-4f30-bb37-3f9e4eaf6de8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.160185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ca6a-c5bd-4f30-bb37-3f9e4eaf6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.188344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e641ca6a-c5bd-4f30-bb37-3f9e4eaf6de8 None None] MFA Rules not processed for user `a7f5a95c229a4d2ebf386cd7ce35165b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:24.189640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e641ca6a-c5bd-4f30-bb37-3f9e4eaf6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.213377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee7d4c53a61454f94ac3398439bce27', 'request_id': 'req-d920aed5-1fe4-43af-9fcf-81831b355d8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:24.218738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee7d4c53a61454f94ac3398439bce27', 'request_id': 'req-d920aed5-1fe4-43af-9fcf-81831b355d8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:24.227685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee7d4c53a61454f94ac3398439bce27', 'request_id': 'req-d920aed5-1fe4-43af-9fcf-81831b355d8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:24.240201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] The token cache is being invalidate because project 2ee7d4c53a61454f94ac3398439bce27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:24.240587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:24.241263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:24.243032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 949/1885] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:24 2022] DELETE /identity/v3/projects/2ee7d4c53a61454f94ac3398439bce27 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:24.243858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.245186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.261453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 937/1886] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:24.265987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.266483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.266757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.285933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:24.287251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.315339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920aed5-1fe4-43af-9fcf-81831b355d8f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.320108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.321065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.321347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.321622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] PATH_INFO: `/v3/projects/5179231c770241b8a877e32dd3ac2f65/users/c103ddca809e4da19fb1db3e64dff41b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.337764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5179231c770241b8a877e32dd3ac2f65, user_id=c103ddca809e4da19fb1db3e64dff41b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.340552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efde25-f8fc-4d51-965f-bec610e6c8a5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.352534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 938/1887] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:24.353395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.354903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.368107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a440a-043d-4950-9c6c-91875a14ae4f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.374608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 950/1888] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:24 2022] PUT /identity/v3/projects/5179231c770241b8a877e32dd3ac2f65/users/c103ddca809e4da19fb1db3e64dff41b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:24.374608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.374608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.374608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.393623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:24.395120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.434223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.434896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.435177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.435447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.436140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.438085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.456225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 951/1889] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:24.457326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.468773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 939/1890] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:24.468919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa2877-845b-40b7-821c-30ffc0eaf24a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.469015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.525380 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.526082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.526362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.526638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.527375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.529059 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.530813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066135e4-a96d-408c-a5de-e7ca0620da9c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.540487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.541189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.541451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.541759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.542477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:24.542796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.544452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.547576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 952/1891] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:24.548485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.557135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 940/1892] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:24.557945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.559554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2fa0-7fc6-4583-8298-04976a6bb509 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.564562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.565212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.565490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.565762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.566474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.567719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a7fe5-b38b-4c56-9b26-8d2cccbcec25 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.568369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.572533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.573391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.573701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.573979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] PATH_INFO: `/v3/projects/5179231c770241b8a877e32dd3ac2f65/users/c103ddca809e4da19fb1db3e64dff41b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.576000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5179231c770241b8a877e32dd3ac2f65, user_id=c103ddca809e4da19fb1db3e64dff41b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.578728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.590875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 953/1893] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:24.590875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.591111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 941/1894] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:24 2022] PUT /identity/v3/projects/5179231c770241b8a877e32dd3ac2f65/users/c103ddca809e4da19fb1db3e64dff41b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:24.598312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397dc4-ab3d-430a-b34c-8540c390165e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.599849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.654779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.655455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.655735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.656008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.656731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.659282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.664788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fae8a-4c3a-4f77-9bd4-681c1a7bbf71 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.670185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.670453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.670738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.671014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.671890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.673610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57255f33-458c-4d79-b57b-b9902d4d50c1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.688167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 942/1895] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:24.688167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.688167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.688167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.697294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 954/1896] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:24.698450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.717914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] MFA Rules not processed for user `c103ddca809e4da19fb1db3e64dff41b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:24.718759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.778648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f5a68-a0db-406a-a534-3406af6df5a0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.784418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.785425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.785710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.785985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] PATH_INFO: `/v3/projects/b6f1d847759f4efeac6b4353fb5becb8/users/59177b76e18544df86f096e8a38cab10/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.810656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1d847759f4efeac6b4353fb5becb8, user_id=59177b76e18544df86f096e8a38cab10, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.813357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.816587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 943/1897] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:24.818701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.831460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a95e4e-2b75-4cf2-9d28-5276dbb86745 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.837933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 955/1898] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:24 2022] PUT /identity/v3/projects/b6f1d847759f4efeac6b4353fb5becb8/users/59177b76e18544df86f096e8a38cab10/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:24.838768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.840340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:24.901273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb8b5c-1e27-4125-a354-9c01780b7e23 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.903593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.904665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.905083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.905589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.905704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.905960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.906231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.906449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.907444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.910513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.939360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 944/1899] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:24 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:24.939360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.949868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2ec0-d1fc-4224-8365-010b5b5ebb74 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.955071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.956096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.956096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.956295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.957087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.958742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.974439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 945/1900] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:24.974439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:24.981798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481863-4b59-4f72-8e17-097ec2bcd6b7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:24.987962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:24.988927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:24.989224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.989345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:24.989605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:24.990349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:24.991080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:24.992011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.002859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 956/1901] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:25.003675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 946/1902] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:25.008314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.015924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.027797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313f7a-5f0b-414c-81e2-6bd8d1834f0a service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.029842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4445bf-a6c2-4e32-9042-a8eafe586acc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.035502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.036909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.037214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.037856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.038178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.038464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.038738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.039086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] PATH_INFO: `/v3/projects/b6f1d847759f4efeac6b4353fb5becb8/users/59177b76e18544df86f096e8a38cab10/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.039464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.041227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.043130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1d847759f4efeac6b4353fb5becb8, user_id=59177b76e18544df86f096e8a38cab10, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.051778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ebb2c-fe53-42c1-a6f2-9b1d5e29cc52 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.055356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 947/1903] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:25.059192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.072488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccc093-c9ec-42be-aae0-a87a0f203035 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.082026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 957/1904] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:25 2022] PUT /identity/v3/projects/b6f1d847759f4efeac6b4353fb5becb8/users/59177b76e18544df86f096e8a38cab10/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:25.102587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.103266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.103869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.139955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] MFA Rules not processed for user `59177b76e18544df86f096e8a38cab10`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:25.141473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.147589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.149085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.149085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.149367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] PATH_INFO: `/v3/projects/c0f3d3cb2e8b44f3976c17ee9adf25e6/users/39c57d6916864da1ac5a7ff39b0b1c27/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.168864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f3d3cb2e8b44f3976c17ee9adf25e6, user_id=39c57d6916864da1ac5a7ff39b0b1c27, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.172760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb57e-465e-4654-a457-dc676449455c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.190898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 948/1905] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:25 2022] PUT /identity/v3/projects/c0f3d3cb2e8b44f3976c17ee9adf25e6/users/39c57d6916864da1ac5a7ff39b0b1c27/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:25.195947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.196453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.197759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.227625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:25.229012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.264896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 958/1906] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:25.273988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.275403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.300209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 949/1907] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:25.310273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.312918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.339980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891a3e-1e91-4be9-94dd-744920312c33 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.382935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc7fc-1925-4091-92e2-6e3e2468fd99 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.387373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.388181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.388505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.388791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.395011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.395881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.396358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.396865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.399721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.401204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.411181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 950/1908] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:25.466334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.467771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.478092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 959/1909] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:25.484610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.495999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396f690-2e22-48d2-a29e-44d9df2bd256 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.501059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.502246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.502616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.503164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] PATH_INFO: `/v3/users/a119b50f39c543fca7ce4a1f0e966a1d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.504682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a119b50f39c543fca7ce4a1f0e966a1d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.507372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.562677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.571478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412faa-ff50-4b10-b860-1d2ddec67a43 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.571689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a119b50f39c543fca7ce4a1f0e966a1d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:25.575839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.576524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.576866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.577140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.594490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a119b50f39c543fca7ce4a1f0e966a1d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:25.602122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a119b50f39c543fca7ce4a1f0e966a1d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:25.603350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a119b50f39c543fca7ce4a1f0e966a1d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:25.610926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b23f3b0-1eba-4a46-ba93-9c4149a16801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a119b50f39c543fca7ce4a1f0e966a1d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:25.617572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 951/1910] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:25 2022] DELETE /identity/v3/users/a119b50f39c543fca7ce4a1f0e966a1d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:25.622025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3de08-f007-434e-9ac8-c98fe9a9b645 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.622311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3de08-f007-434e-9ac8-c98fe9a9b645 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.622591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3de08-f007-434e-9ac8-c98fe9a9b645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.640368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b9c3de08-f007-434e-9ac8-c98fe9a9b645 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:25.641612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b9c3de08-f007-434e-9ac8-c98fe9a9b645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.660979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.662610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.673163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 960/1911] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:25.716105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 952/1912] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:25.730712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:25.732910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:25.757730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57de7c-b390-4aa6-867e-30b28543ff68 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:25.831005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:25.831984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:25.832398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:25.832930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:25.846522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:25.848660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:25.865732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 961/1913] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:26.357346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.357346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.357561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.377300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.378821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.401932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] MFA Rules not processed for user `39c57d6916864da1ac5a7ff39b0b1c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:26.403423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.405271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080364-a6a5-4847-bf42-e30a731d4d51 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.414219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.415093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.415368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.415686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] PATH_INFO: `/v3/projects/dc8d47208d774973a54e404479b2e942` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.416946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8d47208d774973a54e404479b2e942)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.418924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.496391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 953/1914] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:26.501198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.502958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.521631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cadade-d956-4dc1-b885-22a0cbdfe626 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.527806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8d47208d774973a54e404479b2e942', 'request_id': 'req-8ee18155-6f38-451a-90fd-4e76d80dd790'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.534587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8d47208d774973a54e404479b2e942', 'request_id': 'req-8ee18155-6f38-451a-90fd-4e76d80dd790'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.545587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8d47208d774973a54e404479b2e942', 'request_id': 'req-8ee18155-6f38-451a-90fd-4e76d80dd790'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.561987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] The token cache is being invalidate because project dc8d47208d774973a54e404479b2e942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:26.562375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.563274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.565046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 962/1915] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:26 2022] DELETE /identity/v3/projects/dc8d47208d774973a54e404479b2e942 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:26.569028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.570548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.600559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.601237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.601519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.601793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.602487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.604404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.629730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 954/1916] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:26 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:26.633703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.635256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.636995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18155-6f38-451a-90fd-4e76d80dd790 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.694785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.695676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.695958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.696230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] PATH_INFO: `/v3/users/c103ddca809e4da19fb1db3e64dff41b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.697516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c103ddca809e4da19fb1db3e64dff41b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.697931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235598-c8cd-4243-97a0-c67439ecdf8f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.699510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.702515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.703180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.703456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.703728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.705083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.707009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.727537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 955/1917] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:26 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:26.731674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.742160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9016f0c-848e-4b07-bbd4-9b886aebd246 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.747098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c103ddca809e4da19fb1db3e64dff41b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.747232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.747888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.747991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c103ddca809e4da19fb1db3e64dff41b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.748217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.748521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.754006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.758405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.766720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c103ddca809e4da19fb1db3e64dff41b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.769617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 956/1918] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:26.773564 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.774296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c103ddca809e4da19fb1db3e64dff41b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.775264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:26.783064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c103ddca809e4da19fb1db3e64dff41b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:26.789830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2561-7dad-4c4a-9652-d119531dfef8 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:26.792019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 963/1919] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:26 2022] DELETE /identity/v3/users/c103ddca809e4da19fb1db3e64dff41b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:26.854815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:26.855796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:26.856102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:26.856455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] PATH_INFO: `/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf/users/eb94b3d90b914bed9d415ef0c889d4e3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:26.881528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4fa1da43b6458eaf302e875dbe7edf, user_id=eb94b3d90b914bed9d415ef0c889d4e3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:26.887845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:26.904924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 957/1920] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:26 2022] PUT /identity/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf/users/eb94b3d90b914bed9d415ef0c889d4e3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:26.908970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:26.935488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415b585-d3df-43d6-a7b8-cee8ba630b97 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.066516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.067908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.067908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.068162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.071207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.073002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:27.091560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 964/1921] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:27.095379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:27.105716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887c17-0944-441c-8699-cc09fc6c022a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.111424 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.112330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.112634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.113447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] PATH_INFO: `/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf/users/eb94b3d90b914bed9d415ef0c889d4e3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.115172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4fa1da43b6458eaf302e875dbe7edf, user_id=eb94b3d90b914bed9d415ef0c889d4e3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.118561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf42e3-ea92-45fb-b966-152897f12abf admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:27.141238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 958/1922] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:27 2022] PUT /identity/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf/users/eb94b3d90b914bed9d415ef0c889d4e3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:27.155927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:27.157920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:27.189398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba42b-0f8b-494b-9f7f-f567595cbfcf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.293499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.294834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.295246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.296001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] PATH_INFO: `/v3/projects/5179231c770241b8a877e32dd3ac2f65` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.297585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5179231c770241b8a877e32dd3ac2f65)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.299921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:27.394325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5179231c770241b8a877e32dd3ac2f65', 'request_id': 'req-b84f3745-ae38-4637-813e-1a519a6326cc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:27.403798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5179231c770241b8a877e32dd3ac2f65', 'request_id': 'req-b84f3745-ae38-4637-813e-1a519a6326cc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:27.414017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5179231c770241b8a877e32dd3ac2f65', 'request_id': 'req-b84f3745-ae38-4637-813e-1a519a6326cc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:27.439113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] The token cache is being invalidate because project 5179231c770241b8a877e32dd3ac2f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:27.439282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:27.442340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b84f3745-ae38-4637-813e-1a519a6326cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:27.444327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 965/1923] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:27 2022] DELETE /identity/v3/projects/5179231c770241b8a877e32dd3ac2f65 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:27.450877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.451230 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.451575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.475823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:27.477106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:27.608690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 959/1924] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:27.617411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.617708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.617982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.652202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:27.655134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:27.675288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 966/1925] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:27.680116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:27.694619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2ab97-7d13-4b20-807e-b2074a243a91 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.710554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.711333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.711710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.712037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.712948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:27.713315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.716255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:27.753527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 960/1926] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:27.758513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:27.781265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef39bf-bea5-413b-8f84-baa2a96268b7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.786925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.787706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.787936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.789737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.790440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.792477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:27.839124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 967/1927] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:27 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:27.843410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:27.857017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9aab-5cec-4277-b6b6-62ef0edfd261 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:27.963370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:27.964353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:27.964871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:27.965880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:27.968019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:27.971000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.009573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 961/1928] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:27 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:28.013900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.026006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3915b6-7b26-4031-9218-d9f1f9e70ec4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.032523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.033486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.033819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.034238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.035664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.038207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.059461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 968/1929] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:28.062199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.079085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d54d-f9e0-4eff-b641-ac806e506f22 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.087007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.087918 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.088206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.088787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.089590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.091560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21e7f7-1e97-4786-ba2a-bc99b15927f3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.103462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 962/1930] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:28.107891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.123008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53d97-db5a-470a-b9fe-732c2818dcc6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.142068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.142438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.143122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.146914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.148048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.148268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.148572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] PATH_INFO: `/v3/projects/7127d5f8016d494a960dbf4206638248/users/3291a5aa1bff46c8a519493b5276b9c2/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.183054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] MFA Rules not processed for user `eb94b3d90b914bed9d415ef0c889d4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:28.184327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.192528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7127d5f8016d494a960dbf4206638248, user_id=3291a5aa1bff46c8a519493b5276b9c2, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.196085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d6580-3a1c-4f84-8c02-11e4997cbfc7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.212387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 969/1931] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:28 2022] PUT /identity/v3/projects/7127d5f8016d494a960dbf4206638248/users/3291a5aa1bff46c8a519493b5276b9c2/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:28.229676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.229966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.230715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.262014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] MFA Rules not processed for user `3291a5aa1bff46c8a519493b5276b9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:28.263247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.272494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 963/1932] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:28.283079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.284538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.340960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 970/1933] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:28.345753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.355413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f103c8a-09cb-45f9-8e22-b7cdd102ddc1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.407595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.408250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.408566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.408839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.410813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.411013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acff32e-7560-4299-b9c7-5bfe0bf2fa16 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.416376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.417167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.417453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.417731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.418525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.420598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.448485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 971/1934] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:28.450869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.472915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.474533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.485722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 964/1935] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:28.513032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334d0f-b6b6-4a0e-b0ab-f4215a57b967 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.519208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.520104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.520408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.520791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.521399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.526308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.551716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 972/1936] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:28.553088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.564307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b5da-f823-4b0a-aa6b-7341e316082d service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.569904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.570887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.571317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.571568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.572928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.574950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.586949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 965/1937] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:28.591255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.603086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea249b-3404-4801-b8db-4254bfe8b9c0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.607213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.609546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.610343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.611332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.612047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.612047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] PATH_INFO: `/v3/projects/9757636f17e7428583e93e9e06511250/users/80571a75a1824e85916dfcc6b9f32a02/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.623225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0e19-3214-4bd0-85c4-933bedd8faee admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.627756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.628669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.629002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.629233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9757636f17e7428583e93e9e06511250, user_id=80571a75a1824e85916dfcc6b9f32a02, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.629341 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] PATH_INFO: `/v3/users/a7f5a95c229a4d2ebf386cd7ce35165b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.630449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f5a95c229a4d2ebf386cd7ce35165b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.632200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.632584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.649790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 973/1938] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:28 2022] PUT /identity/v3/projects/9757636f17e7428583e93e9e06511250/users/80571a75a1824e85916dfcc6b9f32a02/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:28.653885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.687087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f5a95c229a4d2ebf386cd7ce35165b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:28.698669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f5a95c229a4d2ebf386cd7ce35165b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:28.707696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f5a95c229a4d2ebf386cd7ce35165b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:28.709074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f5a95c229a4d2ebf386cd7ce35165b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:28.718932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a060899b-6451-4e79-b351-f3fc773effa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f5a95c229a4d2ebf386cd7ce35165b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:28.719400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d906c4-62c5-4592-8ce8-45117da5dd8b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.725340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.726037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.726368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.726715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.727756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.729262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 966/1939] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:28 2022] DELETE /identity/v3/users/a7f5a95c229a4d2ebf386cd7ce35165b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:28.729532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.733942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69022-f25e-4813-a11e-342a940893ee None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.734273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69022-f25e-4813-a11e-342a940893ee None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.734658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69022-f25e-4813-a11e-342a940893ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.743570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 974/1940] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:28.744697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.746825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.758348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-78e69022-f25e-4813-a11e-342a940893ee None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:28.759612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-78e69022-f25e-4813-a11e-342a940893ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.770016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a2b8-5109-45de-90df-221616e81ddd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:28.862585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:28.863599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.864015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.864295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] PATH_INFO: `/v3/projects/9757636f17e7428583e93e9e06511250/users/80571a75a1824e85916dfcc6b9f32a02/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.866442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9757636f17e7428583e93e9e06511250, user_id=80571a75a1824e85916dfcc6b9f32a02, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:28.869825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744ea5-d6bb-41b3-a2af-ad12982206fb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:28.886044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 975/1941] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:28 2022] PUT /identity/v3/projects/9757636f17e7428583e93e9e06511250/users/80571a75a1824e85916dfcc6b9f32a02/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:28.895851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:28.896148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:28.896431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:28.918416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 967/1942] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:28.926096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e69022-f25e-4813-a11e-342a940893ee None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:28.929423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-78e69022-f25e-4813-a11e-342a940893ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:28.953276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] MFA Rules not processed for user `80571a75a1824e85916dfcc6b9f32a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:28.954744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.016587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e69022-f25e-4813-a11e-342a940893ee None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:29.043919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 976/1943] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:29.054287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:29.056520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.071799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:29.072834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.073126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.073493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.148499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9593ecd-ad8b-4d6a-92a1-eaf45d034cb2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:29.154731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:29.155438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.155723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.156005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.158753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.170479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:29.172642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e157-520f-4ff5-87cd-dd77f44be9e4 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:29.189487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 968/1944] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:29.199181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de53c-6462-4962-a3d9-ee29378a34b2 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.199791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de53c-6462-4962-a3d9-ee29378a34b2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.200545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de53c-6462-4962-a3d9-ee29378a34b2 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.202082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 969/1945] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:37:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:37:29.209377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.209913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.210559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.239596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:29.241078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.279800 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:29.283428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:29.298940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 977/1946] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:29.319904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 970/1947] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:37:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:29.362463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:29.365310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.397356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fcbb-352f-400d-a131-68b197084c78 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:29.406927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e1366-bc69-492f-b561-68649652d342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:29.407930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1366-bc69-492f-b561-68649652d342 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.410082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1366-bc69-492f-b561-68649652d342 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.410464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1366-bc69-492f-b561-68649652d342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.436734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e1366-bc69-492f-b561-68649652d342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:29.438381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e1366-bc69-492f-b561-68649652d342 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:29.451172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 978/1948] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:29.869532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:29.871908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:29.904007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f1f5-9468-43f6-839e-1e0dd8fc1359 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:29.914559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:29.916458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:29.916844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:29.917829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] PATH_INFO: `/v3/projects/0e090872c166451096d16e66ceb33f74` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:29.920363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e090872c166451096d16e66ceb33f74)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:29.925460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:29.985272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e1366-bc69-492f-b561-68649652d342 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:30.005310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e1366-bc69-492f-b561-68649652d342 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:30.026299 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e090872c166451096d16e66ceb33f74', 'request_id': 'req-7198b77f-62d3-4ce3-be2a-e338322e9b3e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.038180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e090872c166451096d16e66ceb33f74', 'request_id': 'req-7198b77f-62d3-4ce3-be2a-e338322e9b3e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.052909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e090872c166451096d16e66ceb33f74', 'request_id': 'req-7198b77f-62d3-4ce3-be2a-e338322e9b3e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.081305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:30.082026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:30.082384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:30.082671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:30.084561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:30.085093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] The token cache is being invalidate because project 0e090872c166451096d16e66ceb33f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:30.085533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.086353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.090875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 971/1949] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:29 2022] DELETE /identity/v3/projects/0e090872c166451096d16e66ceb33f74 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:30.095086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:30.096762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:30.179976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:30.182642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:30.196203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 979/1950] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:30.218723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198b77f-62d3-4ce3-be2a-e338322e9b3e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:30.231665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:30.234178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:30.234736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:30.235276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] PATH_INFO: `/v3/users/59177b76e18544df86f096e8a38cab10` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:30.238556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59177b76e18544df86f096e8a38cab10)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:30.242807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:30.328100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59177b76e18544df86f096e8a38cab10'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.342397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59177b76e18544df86f096e8a38cab10'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.356793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59177b76e18544df86f096e8a38cab10'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.357666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59177b76e18544df86f096e8a38cab10'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.366927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e3cf09f9-c414-4c5e-9870-8462d97a180f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59177b76e18544df86f096e8a38cab10'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.374881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 972/1951] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:30 2022] DELETE /identity/v3/users/59177b76e18544df86f096e8a38cab10 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:30.683436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:30.697626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773f63b-c24b-481e-b0eb-327303623928 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:30.763776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:30.764753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:30.765009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:30.765303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] PATH_INFO: `/v3/projects/b6f1d847759f4efeac6b4353fb5becb8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:30.766526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f1d847759f4efeac6b4353fb5becb8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:30.768458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:30.817790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f1d847759f4efeac6b4353fb5becb8', 'request_id': 'req-6526e43f-794a-424e-8eb1-1e5ece36570a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.822906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f1d847759f4efeac6b4353fb5becb8', 'request_id': 'req-6526e43f-794a-424e-8eb1-1e5ece36570a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.831787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f1d847759f4efeac6b4353fb5becb8', 'request_id': 'req-6526e43f-794a-424e-8eb1-1e5ece36570a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.850127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] The token cache is being invalidate because project b6f1d847759f4efeac6b4353fb5becb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:30.850472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.851228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6526e43f-794a-424e-8eb1-1e5ece36570a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:30.853672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 980/1952] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:30 2022] DELETE /identity/v3/projects/b6f1d847759f4efeac6b4353fb5becb8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:30.858086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:30.858379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:30.858656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:30.880406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:30.881489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:30.949428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 973/1953] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:30.959626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:30.959626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:30.959626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:30.977667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:30.979023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:30.987298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 981/1954] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:30.992593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.001411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae58f1-39a0-4e7c-9171-7db6f567529a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.006300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.007147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.007566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.007986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.009245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:31.009550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.011145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.025151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 974/1955] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:31.032465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.041890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9722ec3-4650-4eec-9790-547f63540eb1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.055117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.055944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.056572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.056850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.059851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.061864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.096481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 982/1956] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:31 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:31.097722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.107644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbd7d-da5d-45fa-9a82-0614e47f097a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.189212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.190618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.190901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.191406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.192401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.196139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.219920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 975/1957] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:31 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:31.224466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.238443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db0174-893f-4e35-b2cd-f5387b00704c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.243139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.243801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.244088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.244359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.245128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.246743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.257443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 983/1958] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:31.261567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.271638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e92ca3-aa73-481b-b6b6-052f8f0aa0bc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.276232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.276880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.277159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.277429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.278146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.279739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef3130-c8d7-4507-aaea-0a3588263ee3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.292477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 976/1959] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:31.294489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.305386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af050-747c-4a24-853b-c4ffa64ff480 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.310298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.311239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.311520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.311819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] PATH_INFO: `/v3/projects/eaf722e91a2f4b96985e11dfd70b0965/users/6ddac0afeee34b1e83b1dd3a2b92f0ab/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.327602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf722e91a2f4b96985e11dfd70b0965, user_id=6ddac0afeee34b1e83b1dd3a2b92f0ab, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.330890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.346200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 984/1960] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:31 2022] PUT /identity/v3/projects/eaf722e91a2f4b96985e11dfd70b0965/users/6ddac0afeee34b1e83b1dd3a2b92f0ab/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:31.357576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.357934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.358262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.387239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] MFA Rules not processed for user `6ddac0afeee34b1e83b1dd3a2b92f0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:31.388578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:31.452233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 977/1961] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:31.457335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.543048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f7eb-6592-4963-9eac-f93704071926 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.553865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.554567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.554912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.555247 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.556016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.558034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.592983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 985/1962] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:31 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:31.597370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.640839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84694-0c3b-4bfa-8232-7ada8868394c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.769730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.773868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.774376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.774832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.776360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.779031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.807520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 978/1963] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:31 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:31.811364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.827387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1cf3-6024-45af-a429-c3e2655568cc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.834838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.835529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.835805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.836168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.836929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.838759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.858867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 986/1964] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:31.869301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.886352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9906c7-c2e2-44a3-bce9-c794a0ccd270 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:31.893479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:31.894470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:31.894855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:31.895201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] PATH_INFO: `/v3/projects/728eb22430334bcfb06a888898125cc5/users/dc38f23d8bd64781a464d248d7e780fd/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:31.916559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] RBAC: Authorizing `identity:create_grant(project_id=728eb22430334bcfb06a888898125cc5, user_id=dc38f23d8bd64781a464d248d7e780fd, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:31.921665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:31.947913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 979/1965] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:31 2022] PUT /identity/v3/projects/728eb22430334bcfb06a888898125cc5/users/dc38f23d8bd64781a464d248d7e780fd/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:31.960531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:31.971900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60698c3-260e-4ba1-ba8c-dc1ffd8a0823 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:32.030637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:32.031781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:32.032064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:32.032374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:32.033225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:32.035410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4be17-ccb5-4900-a47d-a8112d0f76bd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:32.046718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 987/1966] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:32.051284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:32.062132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dd4c7-a418-4f88-b357-b387f5ad892a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:32.066927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:32.067853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:32.068134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:32.068459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] PATH_INFO: `/v3/projects/728eb22430334bcfb06a888898125cc5/users/dc38f23d8bd64781a464d248d7e780fd/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:32.070704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728eb22430334bcfb06a888898125cc5, user_id=dc38f23d8bd64781a464d248d7e780fd, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:32.073904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:32.086054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 980/1967] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:32 2022] PUT /identity/v3/projects/728eb22430334bcfb06a888898125cc5/users/dc38f23d8bd64781a464d248d7e780fd/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:32.097604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:32.097924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:32.098204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:32.132845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] MFA Rules not processed for user `dc38f23d8bd64781a464d248d7e780fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:32.134186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:32.230531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 988/1968] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:32.238082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:32.240809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:32.323059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd3b1-1b3b-4004-888b-2cf704daa685 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:32.327149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:32.327809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:32.328302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:32.328623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:32.396872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:32.398471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:32.407850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 981/1969] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:34.104230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:34.105972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:34.133429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd01a8-4a51-479e-993e-d419ea3abce9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:34.137230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:34.138017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:34.138520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:34.138974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:34.141081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:34.217362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:34.218842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:34.229031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 989/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:40.197462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:40.206097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd790-6c67-474f-b7b4-31986f978906 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:40.210468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:40.211120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:40.211403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:40.211676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:40.221572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:40.224189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3cdc5-4951-4a32-942d-5690397e34e8 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:40.235455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 982/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:41.014390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:41.015817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:41.087420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf8fd1-41d0-4a26-a4ab-6d65e0f9cc94 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:41.092575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:41.093557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:41.093896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:41.094233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] PATH_INFO: `/v3/users/31e451616b7c487d83894e12f7a98021` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:41.095511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e451616b7c487d83894e12f7a98021)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:41.097624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:41.157213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e451616b7c487d83894e12f7a98021'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.158127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e451616b7c487d83894e12f7a98021'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.174285 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e451616b7c487d83894e12f7a98021'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.184164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e451616b7c487d83894e12f7a98021'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.193018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e451616b7c487d83894e12f7a98021'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.200601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 990/1972] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:41 2022] DELETE /identity/v3/users/31e451616b7c487d83894e12f7a98021 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:41.205493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:41.205983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:41.206095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:41.224002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:41.226194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:41.298843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 983/1973] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:41.308948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:41.310373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:41.365154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc76b1-6c4e-47c7-8306-b3722bbd95d5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:41.369771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:41.370427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:41.370734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:41.371001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:41.385639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:41.387923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:41.401138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 991/1974] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:41.681267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:41.682723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:41.698568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801ce2-b85c-4775-a583-1a1b452aab46 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:41.703618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:41.704429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:41.704694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:41.705023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] PATH_INFO: `/v3/projects/c8ef749701ca456ca2f6bd8abc5dce5c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:41.706355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ef749701ca456ca2f6bd8abc5dce5c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:41.708287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:41.756237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ef749701ca456ca2f6bd8abc5dce5c', 'request_id': 'req-ccc29657-81bd-4697-9541-4884be72c66d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.761406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ef749701ca456ca2f6bd8abc5dce5c', 'request_id': 'req-ccc29657-81bd-4697-9541-4884be72c66d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.769754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ef749701ca456ca2f6bd8abc5dce5c', 'request_id': 'req-ccc29657-81bd-4697-9541-4884be72c66d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.780409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] The token cache is being invalidate because project c8ef749701ca456ca2f6bd8abc5dce5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:41.780730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.781444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.783061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 984/1975] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:41 2022] DELETE /identity/v3/projects/c8ef749701ca456ca2f6bd8abc5dce5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:41.787120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:41.797719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67b2-3479-4bd9-97b6-144b1214616e service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:41.855055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:41.855933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:41.856215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:41.856524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] PATH_INFO: `/v3/users/c2be7dcdfa22498face0af91c71200d0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:41.857735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2be7dcdfa22498face0af91c71200d0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:41.859664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:41.907325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2be7dcdfa22498face0af91c71200d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.907964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2be7dcdfa22498face0af91c71200d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.919083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2be7dcdfa22498face0af91c71200d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.926221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2be7dcdfa22498face0af91c71200d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.935362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-66de52e4-0ddd-4056-aa6f-5369e9996bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2be7dcdfa22498face0af91c71200d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:41.942186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 992/1976] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:41 2022] DELETE /identity/v3/users/c2be7dcdfa22498face0af91c71200d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:42.211523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.213865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:42.228582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29657-81bd-4697-9541-4884be72c66d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.287191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.288116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.288400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.288711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] PATH_INFO: `/v3/projects/827b4377def546388e1a14c493713df5` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.290302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827b4377def546388e1a14c493713df5)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.292528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.342789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827b4377def546388e1a14c493713df5', 'request_id': 'req-fc171eff-c7a7-4599-a656-b64b64c8f347'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:42.348024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827b4377def546388e1a14c493713df5', 'request_id': 'req-fc171eff-c7a7-4599-a656-b64b64c8f347'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:42.355469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827b4377def546388e1a14c493713df5', 'request_id': 'req-fc171eff-c7a7-4599-a656-b64b64c8f347'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:42.367218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] The token cache is being invalidate because project 827b4377def546388e1a14c493713df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:42.367545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:42.368176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fc171eff-c7a7-4599-a656-b64b64c8f347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:42.369745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 985/1977] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:42 2022] DELETE /identity/v3/projects/827b4377def546388e1a14c493713df5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:42.374774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.375276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.375363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.393296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:42.394486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:42.464761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 993/1978] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:42.473959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.474226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.474524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.493568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:42.494774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:42.503538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 986/1979] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:42.507890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.520426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b0ad2-9e82-4772-8788-affd133312a2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.526252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.526909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.527183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.527457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.528188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:42.528520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.530159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.542417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 994/1980] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:37:42.546883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.557317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a25e5-cbf2-47ff-9000-030d9b191756 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.563435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.564112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.564394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.564891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.565758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.568214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.595380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 987/1981] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:42.601738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.615940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195732-ea2a-4a3f-adb7-5cdadc4b5cfb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.679665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.680746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.681033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.681312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.682007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.683949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.704955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 995/1982] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:42.709189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.719273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a60b3-d6bd-4628-9ef4-a732341d74e4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.723904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.724585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.724861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.725128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.725850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.727427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.737719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 988/1983] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:42.741767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.753169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff850f-8534-4c94-a263-cc0ecff113af admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.758691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.759358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.760690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.760690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.760690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.762243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60340ec-bfdf-4d8a-b3d5-d7024441f556 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.774427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 996/1984] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:42.780863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:42.796933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca813-0aac-476e-a9aa-bee0249a4f7c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:42.804598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:42.805850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.806152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.806380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] PATH_INFO: `/v3/projects/6d79609c6f084b7d8d9d357cbd5fb030/users/505a7494dbce492986f262bbf0a60bfa/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.821358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d79609c6f084b7d8d9d357cbd5fb030, user_id=505a7494dbce492986f262bbf0a60bfa, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:42.824016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:42.838333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 989/1985] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:42 2022] PUT /identity/v3/projects/6d79609c6f084b7d8d9d357cbd5fb030/users/505a7494dbce492986f262bbf0a60bfa/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:42.849714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:42.850082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:42.850486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:42.880548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] MFA Rules not processed for user `505a7494dbce492986f262bbf0a60bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:42.881788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:42.948511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 997/1986] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:42.953257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.019418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fba0e-f159-4c8d-ae6a-34581f08821e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.024752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.025435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.025736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.026081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.026712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.028654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.054991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 990/1987] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:42 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:43.059617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.071324 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcc5ab-12fc-4b37-9d17-90e04758ec40 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.139972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.140682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.140967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.141238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.141935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.143868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.167841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 998/1988] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:43 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:43.171832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.182837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509ac7f-c564-4c00-a289-f804e4e54186 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.187570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.188239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.188556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.188857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.189615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.191211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.201850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 991/1989] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:43.206200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.217105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa18b57-463b-47d7-b659-deba2fb20477 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.222634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.223689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.223972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.224251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] PATH_INFO: `/v3/projects/59c547d4785d41a1abe7bf89dae3fccc/users/a541724f619f4ddb818e7d85fb6927b3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.239914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c547d4785d41a1abe7bf89dae3fccc, user_id=a541724f619f4ddb818e7d85fb6927b3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.242699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.258545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 999/1990] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:43 2022] PUT /identity/v3/projects/59c547d4785d41a1abe7bf89dae3fccc/users/a541724f619f4ddb818e7d85fb6927b3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:43.263196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.275489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62072e-846f-4720-b706-922964489b53 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.335109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.335776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.336045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.336315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.337105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.338733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d70af-5c0a-4998-9726-a15daa33dea9 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.352623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 992/1991] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:43.353691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.364904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af53f5-38b8-4746-a458-089520ac12cb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.370445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.371466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.371895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.372177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] PATH_INFO: `/v3/projects/59c547d4785d41a1abe7bf89dae3fccc/users/a541724f619f4ddb818e7d85fb6927b3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.374426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c547d4785d41a1abe7bf89dae3fccc, user_id=a541724f619f4ddb818e7d85fb6927b3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.377634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.388926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1000/1992] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:43 2022] PUT /identity/v3/projects/59c547d4785d41a1abe7bf89dae3fccc/users/a541724f619f4ddb818e7d85fb6927b3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:43.400473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.400835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.401115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.426854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] MFA Rules not processed for user `a541724f619f4ddb818e7d85fb6927b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:43.428046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:43.503306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 993/1993] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:43.518309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.520702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:43.584229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80693b7-2dd2-49ba-b02a-566f31674676 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.588984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.589968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.590296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.590598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.605223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.607522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44612fe0-36e8-456e-8a7d-b4fda2719c57 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.619786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1001/1994] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:43.647740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.711087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ed22-674a-47a6-b7fd-014af9d338c9 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.715968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.716868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.717144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.717422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] PATH_INFO: `/v3/users/505a7494dbce492986f262bbf0a60bfa` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.718669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505a7494dbce492986f262bbf0a60bfa)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.720613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.770205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505a7494dbce492986f262bbf0a60bfa'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:43.782474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505a7494dbce492986f262bbf0a60bfa'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:43.789610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505a7494dbce492986f262bbf0a60bfa'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:43.790244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505a7494dbce492986f262bbf0a60bfa'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:43.797621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505a7494dbce492986f262bbf0a60bfa'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:43.803344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 994/1995] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:43 2022] DELETE /identity/v3/users/505a7494dbce492986f262bbf0a60bfa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:43.808368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.808689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.808969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.826941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:43.828151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:43.888870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1002/1996] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:43.899707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:43.902185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:43.963822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ea098-96d8-4135-8b3e-94f43e62d8c3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:43.967961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:43.968649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:43.968936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:43.969210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:43.978416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:43.979853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:43.989192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 995/1997] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:44.272458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:44.274002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:44.287144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043744d7-7e6f-4b1a-9a90-127c366b69fd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:44.293011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:44.293894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:44.294212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:44.294487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] PATH_INFO: `/v3/projects/6d79609c6f084b7d8d9d357cbd5fb030` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:44.296176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d79609c6f084b7d8d9d357cbd5fb030)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:44.298192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:44.345199 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d79609c6f084b7d8d9d357cbd5fb030', 'request_id': 'req-e38e2855-2afe-42b8-b71f-b825dc8c3a59'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.350787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d79609c6f084b7d8d9d357cbd5fb030', 'request_id': 'req-e38e2855-2afe-42b8-b71f-b825dc8c3a59'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.358287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d79609c6f084b7d8d9d357cbd5fb030', 'request_id': 'req-e38e2855-2afe-42b8-b71f-b825dc8c3a59'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.369110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] The token cache is being invalidate because project 6d79609c6f084b7d8d9d357cbd5fb030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:44.369398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.370017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.371640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1003/1998] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:44 2022] DELETE /identity/v3/projects/6d79609c6f084b7d8d9d357cbd5fb030 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:44.375881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:44.386203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843ea8-2225-4afe-9426-5ab5cb67ab13 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:44.450148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:44.451077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:44.451361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:44.451640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] PATH_INFO: `/v3/users/a541724f619f4ddb818e7d85fb6927b3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:44.452879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a541724f619f4ddb818e7d85fb6927b3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:44.454817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:44.510110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a541724f619f4ddb818e7d85fb6927b3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.516998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a541724f619f4ddb818e7d85fb6927b3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.523551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a541724f619f4ddb818e7d85fb6927b3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.524256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a541724f619f4ddb818e7d85fb6927b3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.531520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-374fb680-e6d7-4ab8-b413-e86553bab854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a541724f619f4ddb818e7d85fb6927b3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.538067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 996/1999] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:44 2022] DELETE /identity/v3/users/a541724f619f4ddb818e7d85fb6927b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:44.855196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:44.856901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:44.874156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e2855-2afe-42b8-b71f-b825dc8c3a59 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:44.929366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:44.930555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:44.930838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:44.931112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] PATH_INFO: `/v3/projects/59c547d4785d41a1abe7bf89dae3fccc` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:44.932303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c547d4785d41a1abe7bf89dae3fccc)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:44.934261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:44.982551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c547d4785d41a1abe7bf89dae3fccc', 'request_id': 'req-45c54903-2288-440c-980d-1e3137906583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.988146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c547d4785d41a1abe7bf89dae3fccc', 'request_id': 'req-45c54903-2288-440c-980d-1e3137906583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:44.995421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c547d4785d41a1abe7bf89dae3fccc', 'request_id': 'req-45c54903-2288-440c-980d-1e3137906583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.006301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] The token cache is being invalidate because project 59c547d4785d41a1abe7bf89dae3fccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:45.006590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.007224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45c54903-2288-440c-980d-1e3137906583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.008883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1004/2000] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:44 2022] DELETE /identity/v3/projects/59c547d4785d41a1abe7bf89dae3fccc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:45.013839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.014128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.014408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.034469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:45.035672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.099787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 997/2001] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:45.107795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.108189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.108458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.127923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:45.129152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.139420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1005/2002] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:45.143982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.155407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96cf8-b16b-4aae-872e-af89c6c52cd8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.162198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.162924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.163292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.163562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.164539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:45.164807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.166450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.178585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 998/2003] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:45.184189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.194405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a45e1-0b14-4a8f-a22a-f2105cc55f01 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.199545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.200221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.200609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.201066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.201920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.204010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.232083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1006/2004] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:45.236417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.246443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d788a-6036-4145-b034-228129c7311e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.315020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.315697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.315975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.316241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.317008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.319271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.341152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 999/2005] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:45.345652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.355988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c477f-fabd-41d3-9a9b-500f3b890de6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.360537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.361204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.361480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.361751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.362468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.364117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.374643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1007/2006] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:45.379318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.389950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615b57-0e65-45d5-82d4-767b049d0d3e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.395687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.396922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.397417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.397974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.399294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.401457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345cfb1-6d33-44cd-a79b-3d811c8621ea admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.415298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1000/2007] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:45.419400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.432584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2d3f-d037-4305-a53c-40ff34b4a5f3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.437193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.438015 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.438295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.438573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] PATH_INFO: `/v3/projects/652bbf7a8bf842f6ae0f4798ef428e46/users/ed29c00637c2471cae8bda9ac3a396d8/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.452650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652bbf7a8bf842f6ae0f4798ef428e46, user_id=ed29c00637c2471cae8bda9ac3a396d8, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.455333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.467894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1008/2008] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:45 2022] PUT /identity/v3/projects/652bbf7a8bf842f6ae0f4798ef428e46/users/ed29c00637c2471cae8bda9ac3a396d8/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:45.479318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.479318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.479318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.495873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.497721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.505784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] MFA Rules not processed for user `ed29c00637c2471cae8bda9ac3a396d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:45.506957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.567695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124b88-ef27-4670-88e8-d01508910de1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.572002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1001/2009] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:45.573681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.574810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.575627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.576139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] PATH_INFO: `/v3/users/8969dc33ba644f4a904c9d7c237d559e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.576355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.578653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8969dc33ba644f4a904c9d7c237d559e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.580709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.589366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7684ed-a733-47dc-956d-13f28744ff7e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.594509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.595347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.595765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.596234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.597148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.600757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.634811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8969dc33ba644f4a904c9d7c237d559e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.635488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8969dc33ba644f4a904c9d7c237d559e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.641037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1002/2010] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:45.645472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.647485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.649162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8969dc33ba644f4a904c9d7c237d559e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.656688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8969dc33ba644f4a904c9d7c237d559e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.672672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4fa130df-4d2d-42bc-b260-4eb99b0eee99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8969dc33ba644f4a904c9d7c237d559e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:45.680223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1009/2011] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:45 2022] DELETE /identity/v3/users/8969dc33ba644f4a904c9d7c237d559e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:45.685073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.685379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.685652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.704373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:45.706240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.726972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8de5-2214-46c4-abff-0bb06385a93f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.768138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1010/2012] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:45.779701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.781348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:45.789805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.790495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.790811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.791082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.791938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.793952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.825567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1003/2013] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:45 2022] POST /identity/v3/users => generated 307 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:45.826524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.837191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ca2f-7348-44b6-a78f-3be1d5484aa7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.842255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.843180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.843491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.843774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.844591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.846658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.857069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14383850-75c4-4d3e-a9a5-fc4d03c58934 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.859627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1004/2014] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:45.861737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.862402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.862688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.863779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.864623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.874594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e343-726f-4bcc-9d2d-6d2c030e8f50 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:45.875245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.876745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.879768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:45.880738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:45.881020 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:45.881279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] PATH_INFO: `/v3/projects/8e96129d8c754173be98c726bb8982da/users/e1b76ac1b0224a7ca05690c3626a678b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:45.887299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1011/2015] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:45.900649 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e96129d8c754173be98c726bb8982da, user_id=e1b76ac1b0224a7ca05690c3626a678b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:45.904136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:45.927262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1005/2016] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:45 2022] PUT /identity/v3/projects/8e96129d8c754173be98c726bb8982da/users/e1b76ac1b0224a7ca05690c3626a678b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:45.928943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:45.942087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627593-865b-4ee4-baeb-76e0fbf28b7c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.025449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.026331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.026620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.026896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.027623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.029354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750319fe-bb23-4c94-bd0a-e0036de46601 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.039572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1012/2017] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:46.044059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.063962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2e6-6038-49c0-8974-508432f066e6 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.069712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.070697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.071048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.071511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] PATH_INFO: `/v3/projects/8e96129d8c754173be98c726bb8982da/users/e1b76ac1b0224a7ca05690c3626a678b/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.073981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e96129d8c754173be98c726bb8982da, user_id=e1b76ac1b0224a7ca05690c3626a678b, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.077392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.090532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1006/2018] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:46 2022] PUT /identity/v3/projects/8e96129d8c754173be98c726bb8982da/users/e1b76ac1b0224a7ca05690c3626a678b/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:46.103168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.103467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.103756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.134727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] MFA Rules not processed for user `e1b76ac1b0224a7ca05690c3626a678b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:46.135764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.212297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.212297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.233088 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1013/2019] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:46.246527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.249220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.299498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e4616-1430-45ac-aa5c-c9e63f9d04fc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.304194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.305673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.305963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.306309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] PATH_INFO: `/v3/projects/79196f5e18734a918f468dc2c497c8dc` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.307773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79196f5e18734a918f468dc2c497c8dc)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.310081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.312764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2388e45-28c9-4d15-8bfa-31242942bbba None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.316454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.317151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.317982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.318272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.329093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.330541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.341336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1014/2020] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:46.361799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79196f5e18734a918f468dc2c497c8dc', 'request_id': 'req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.368688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79196f5e18734a918f468dc2c497c8dc', 'request_id': 'req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.379502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79196f5e18734a918f468dc2c497c8dc', 'request_id': 'req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.392132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] The token cache is being invalidate because project 79196f5e18734a918f468dc2c497c8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:46.392422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.393143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.394837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1007/2021] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:46 2022] DELETE /identity/v3/projects/79196f5e18734a918f468dc2c497c8dc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:46.399224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.415052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd80a8-d2c3-4662-8e3d-ac7b0069afa8 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.422051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.423462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.467754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.468691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.468968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.469240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] PATH_INFO: `/v3/users/c9bea8f2ddfa4b239bccc20506335e99` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.470443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bea8f2ddfa4b239bccc20506335e99)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.472372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.478663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc79b3-7b0a-4cf9-a7a9-c556b2869cf5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.482325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.482975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.483256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.483553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.485370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.520959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bea8f2ddfa4b239bccc20506335e99'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.520959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bea8f2ddfa4b239bccc20506335e99'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.536901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bea8f2ddfa4b239bccc20506335e99'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.543558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bea8f2ddfa4b239bccc20506335e99'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.549820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.551470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.552326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bea8f2ddfa4b239bccc20506335e99'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.559110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1015/2022] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:46 2022] DELETE /identity/v3/users/c9bea8f2ddfa4b239bccc20506335e99 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:46.560950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1008/2023] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:46.701180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.703412 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.776490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970c48-a085-4b4a-ba9b-8db568c0af56 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.781473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.782363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.782646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.782921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] PATH_INFO: `/v3/users/3291a5aa1bff46c8a519493b5276b9c2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.784152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3291a5aa1bff46c8a519493b5276b9c2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.786190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.843797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3291a5aa1bff46c8a519493b5276b9c2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.844531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3291a5aa1bff46c8a519493b5276b9c2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.866273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:46.866482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3291a5aa1bff46c8a519493b5276b9c2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.867818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.879435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3291a5aa1bff46c8a519493b5276b9c2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.892718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a52cef92-d2fe-4d24-82c7-1e5d8e517516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3291a5aa1bff46c8a519493b5276b9c2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.895718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061ba3-3993-42e4-bda4-331cae54a4b1 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:46.899878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1016/2024] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:46 2022] DELETE /identity/v3/users/3291a5aa1bff46c8a519493b5276b9c2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:46.901730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:46.903008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.903298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.903577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] PATH_INFO: `/v3/projects/60d66b022e514f909a3d7074088c05d8` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.904959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d66b022e514f909a3d7074088c05d8)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:46.906810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.907181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.907301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:46.907456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.930355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:46.932143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:46.958183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d66b022e514f909a3d7074088c05d8', 'request_id': 'req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.963401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d66b022e514f909a3d7074088c05d8', 'request_id': 'req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.973422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d66b022e514f909a3d7074088c05d8', 'request_id': 'req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.984880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] The token cache is being invalidate because project 60d66b022e514f909a3d7074088c05d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:46.985357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.985992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-3c556b34-a3fc-4275-8e77-0a87d6d0f7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:46.987549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1009/2025] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:46 2022] DELETE /identity/v3/projects/60d66b022e514f909a3d7074088c05d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:46.992968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b342d1-fb88-4205-88a7-28b98110a3e6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:46.993260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b342d1-fb88-4205-88a7-28b98110a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:46.993539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b342d1-fb88-4205-88a7-28b98110a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:46.993650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1017/2026] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:47.005467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.006854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.013226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a5b342d1-fb88-4205-88a7-28b98110a3e6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:47.014494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a5b342d1-fb88-4205-88a7-28b98110a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.068150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d7476-98e8-48ff-9bdd-aae70de3b41c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.079047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1010/2027] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:47.087405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.087694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.087975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.105833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:47.107032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.115863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1011/2028] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:47.120029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.121537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.122268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.122622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.122968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.128908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f124cd3-8707-41ae-bb75-f3f82496838b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.132989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.133847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.134517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.134629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.135106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.135106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.135769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:47.136070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.137708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.144391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1018/2029] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:47.150820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1012/2030] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:37:47.155180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.166217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b4df4-f2b8-429f-ab28-dfd149e1b5ee service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.172076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.172765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.173046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.173320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.174024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.176123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.204288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1019/2031] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:47.210245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.228358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ee84-796a-4620-8ae2-7a00311e3edd admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.325576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.327134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.327805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.328092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.328827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.330801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.354686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1013/2032] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:47.358877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.369196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e154e-6726-4a6a-acd4-da3b3c9728a5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.373998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.374669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.374956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.375232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.375963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.377607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.388338 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1020/2033] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:47.392491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.404263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebfc3e-517a-4e3c-bffa-d4ac426fa36e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.411696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.412413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.412744 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.413147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.414050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.416983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.428086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1014/2034] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:47.433437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.443700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f71a2-b5f5-44b8-a96a-50c1f2e78fdf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.449269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.450286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.450604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.450881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] PATH_INFO: `/v3/projects/598e534b639f47ef82b055398a51e26c/users/305e55337bbe4ea39080af41851aa554/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.457924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.460532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.472685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598e534b639f47ef82b055398a51e26c, user_id=305e55337bbe4ea39080af41851aa554, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.475395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fa79a-ca67-4619-92db-02ac532b7799 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.477074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc349-ea09-46c0-9d0b-906211835aa4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.483379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.484292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.484613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.484888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] PATH_INFO: `/v3/projects/7127d5f8016d494a960dbf4206638248` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.486322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7127d5f8016d494a960dbf4206638248)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.488723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.494825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1021/2035] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:47 2022] PUT /identity/v3/projects/598e534b639f47ef82b055398a51e26c/users/305e55337bbe4ea39080af41851aa554/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:47.505757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.506075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.506325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.533899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] MFA Rules not processed for user `305e55337bbe4ea39080af41851aa554`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:47.535252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.535652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7127d5f8016d494a960dbf4206638248', 'request_id': 'req-ba49f6bf-7194-4c36-aef4-29c865979bf4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.540874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7127d5f8016d494a960dbf4206638248', 'request_id': 'req-ba49f6bf-7194-4c36-aef4-29c865979bf4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.548282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7127d5f8016d494a960dbf4206638248', 'request_id': 'req-ba49f6bf-7194-4c36-aef4-29c865979bf4'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.560328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] The token cache is being invalidate because project 7127d5f8016d494a960dbf4206638248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:47.560637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.561273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.563115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1015/2036] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:47 2022] DELETE /identity/v3/projects/7127d5f8016d494a960dbf4206638248 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:47.566665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.568144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.598815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1022/2037] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:47.603383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.604781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.629757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f6bf-7194-4c36-aef4-29c865979bf4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.634712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.635605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.636339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.636339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] PATH_INFO: `/v3/users/80571a75a1824e85916dfcc6b9f32a02` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.637557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80571a75a1824e85916dfcc6b9f32a02)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.639778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.669364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca578-d348-410f-8860-345f6e4dee27 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.674743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.675415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.675720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.676054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.676961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.679099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.692526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80571a75a1824e85916dfcc6b9f32a02'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.704487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80571a75a1824e85916dfcc6b9f32a02'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.704632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1023/2038] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:47.708754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.711361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80571a75a1824e85916dfcc6b9f32a02'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.712038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80571a75a1824e85916dfcc6b9f32a02'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.719841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80571a75a1824e85916dfcc6b9f32a02'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:47.725763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1016/2039] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:47 2022] DELETE /identity/v3/users/80571a75a1824e85916dfcc6b9f32a02 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:47.776049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e636ea-9e36-4a77-9836-7eaa7bbb45df admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.834098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.834787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.835074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.835370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.836062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.838021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.859333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1024/2040] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:47 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:47.863389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.865110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:47.890968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475221-8f25-4510-8ee4-a50c08ecb05c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.898848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.899570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.899932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.900133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.900920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.902540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.916332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1017/2041] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:47.917530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.931107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2deca-d698-4a37-8b2a-696df8a98f7e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.936076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:47.937051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:47.937336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:47.937612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] PATH_INFO: `/v3/projects/34698c1c313c4375a691eeefdf5b0fab/users/a41f0c2669c040cdb38fddd33e015ec7/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:47.953535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34698c1c313c4375a691eeefdf5b0fab, user_id=a41f0c2669c040cdb38fddd33e015ec7, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:47.956220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:47.970215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1025/2042] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:47 2022] PUT /identity/v3/projects/34698c1c313c4375a691eeefdf5b0fab/users/a41f0c2669c040cdb38fddd33e015ec7/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:47.978768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.989297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3ea2-ce26-48e9-a6c5-209ac68790c6 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:47.996402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:47.998209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.051414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.052179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.052551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.052888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.053678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.055726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.060341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163983ee-6e42-4969-b7ce-a101d5f54740 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.065010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.065552 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1018/2043] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:48.065967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.066415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.066890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] PATH_INFO: `/v3/projects/9757636f17e7428583e93e9e06511250` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.068133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9757636f17e7428583e93e9e06511250)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.069785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.070355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.079669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58a31-2e92-4f93-97c4-b34414e8cffa admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.084307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.085223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.085522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.085746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] PATH_INFO: `/v3/projects/34698c1c313c4375a691eeefdf5b0fab/users/a41f0c2669c040cdb38fddd33e015ec7/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.087768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34698c1c313c4375a691eeefdf5b0fab, user_id=a41f0c2669c040cdb38fddd33e015ec7, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.090447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d746f-a170-4c60-b74e-e114ebe69849 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.100659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1019/2044] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:48 2022] PUT /identity/v3/projects/34698c1c313c4375a691eeefdf5b0fab/users/a41f0c2669c040cdb38fddd33e015ec7/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:48.110541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.110822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.111095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.117169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9757636f17e7428583e93e9e06511250', 'request_id': 'req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:48.122378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9757636f17e7428583e93e9e06511250', 'request_id': 'req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:48.130665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9757636f17e7428583e93e9e06511250', 'request_id': 'req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:48.137371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] MFA Rules not processed for user `a41f0c2669c040cdb38fddd33e015ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:48.138664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.142073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] The token cache is being invalidate because project 9757636f17e7428583e93e9e06511250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:48.142366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:48.143090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5bf3564a-57c7-4f2e-88f6-3c08eefe031a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:48.149356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1026/2045] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:47 2022] DELETE /identity/v3/projects/9757636f17e7428583e93e9e06511250 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:37:48.150939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-bbba-451a-b7ca-a0921784c7fc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.151244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-bbba-451a-b7ca-a0921784c7fc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.151511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-bbba-451a-b7ca-a0921784c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.171549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ef3b32ee-bbba-451a-b7ca-a0921784c7fc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:48.172799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ef3b32ee-bbba-451a-b7ca-a0921784c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.206530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1020/2046] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:48.217958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.219438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.231921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1027/2047] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:48.240279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.240603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.240899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.258816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:48.259932 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.268105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1028/2048] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:48.272786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.278671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9bcf-6844-4b52-9959-1cbd8692ef1e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.282230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afff96-46f6-465b-8c87-48344d3e2313 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.287089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.287759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.288034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.288320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.288597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.288970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.289074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:48.289251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.289346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.289525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.290947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.299289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.300772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.302906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1029/2049] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:48.308466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.311072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1021/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:48.318977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff186c-ffe5-4788-81be-989f5a7dbc5f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.323949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.324737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.325074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.325411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.326204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.328298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.356894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1030/2051] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:48.359140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.360705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.360850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.371598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ead39-e7f1-4d2b-a50f-c3de2c399fb4 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.417607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.418294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.418529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.418803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.419650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b3d-c5ca-4a07-96d5-044e8eb26882 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.420674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.424302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.424984 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.425265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.425535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.426289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.428196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.456649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1031/2052] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:48.457477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.467661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4777-53ac-41f8-a5fa-a26c045e0500 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.473475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.474142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.474425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.474690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.475543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.477072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.482183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.484082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.487628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1032/2053] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:48.491465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.494035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1022/2054] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:48.501311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1bde-b3a1-4a23-8ca1-7e835e74cabd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.506377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.507026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.507273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.507563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.508249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.509917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8074-a09f-40e7-a308-025168da690d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.521432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1033/2055] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:37:48.525669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.536670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518adbe-12b0-4c0a-a945-9c9ddbcec8e1 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.542306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.543350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.543612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.543887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] PATH_INFO: `/v3/projects/c2fbed6c23aa4d8b83cf4c6d4c909de0/users/16c0b5750d4241a8a4ee95f6bfc00747/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.560011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fbed6c23aa4d8b83cf4c6d4c909de0, user_id=16c0b5750d4241a8a4ee95f6bfc00747, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.562739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.576273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1023/2056] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:48 2022] PUT /identity/v3/projects/c2fbed6c23aa4d8b83cf4c6d4c909de0/users/16c0b5750d4241a8a4ee95f6bfc00747/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:48.587631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.587923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.588203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.614706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] MFA Rules not processed for user `16c0b5750d4241a8a4ee95f6bfc00747`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:48.615946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.686467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1034/2057] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:48.697845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:48.767281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40bb4a-7c11-4382-8aa3-56f3ecf1cecc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:48.772321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:48.773173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.773545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.773998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.786015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:48.787487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04836-6565-43a4-9c95-84c2c8f01a4b service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:48.797322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1024/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:52.049431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:52.051564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:52.132841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69486963-f1dd-4d8e-8487-b0fd4e359872 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:52.138144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:52.139031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:52.139312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:52.139586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] PATH_INFO: `/v3/users/305e55337bbe4ea39080af41851aa554` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:52.141067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=305e55337bbe4ea39080af41851aa554)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:52.143053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:52.194757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305e55337bbe4ea39080af41851aa554'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.195438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305e55337bbe4ea39080af41851aa554'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.209034 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305e55337bbe4ea39080af41851aa554'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.216342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305e55337bbe4ea39080af41851aa554'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.225176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305e55337bbe4ea39080af41851aa554'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.231198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1035/2059] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:52 2022] DELETE /identity/v3/users/305e55337bbe4ea39080af41851aa554 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:52.235707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:52.236171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:52.236303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:52.253500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:52.254795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:52.313306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1025/2060] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:52.326310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:52.328939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:52.391213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d0e6d-9807-404e-b951-b3134c3a54cd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:52.395572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:52.396272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:52.396586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:52.396862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:52.406922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:52.408346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:52.418457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1036/2061] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:52.686705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:52.688160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:52.700244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2988d-e007-4418-bb6a-1e97343e2001 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:52.705242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:52.706109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:52.706387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:52.706641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] PATH_INFO: `/v3/projects/598e534b639f47ef82b055398a51e26c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:52.708009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598e534b639f47ef82b055398a51e26c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:52.710261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:52.757475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598e534b639f47ef82b055398a51e26c', 'request_id': 'req-e43834cc-d24c-43ec-ba45-3d243f3ae586'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.763527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598e534b639f47ef82b055398a51e26c', 'request_id': 'req-e43834cc-d24c-43ec-ba45-3d243f3ae586'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.771862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598e534b639f47ef82b055398a51e26c', 'request_id': 'req-e43834cc-d24c-43ec-ba45-3d243f3ae586'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.785203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] The token cache is being invalidate because project 598e534b639f47ef82b055398a51e26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:52.785480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.786315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.787914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1026/2062] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:52 2022] DELETE /identity/v3/projects/598e534b639f47ef82b055398a51e26c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:52.792921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:52.808381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c72ce-4481-4fa3-a881-c0ddaa75fd29 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:52.869138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:52.869922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:52.870206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:52.870480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] PATH_INFO: `/v3/users/a41f0c2669c040cdb38fddd33e015ec7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:52.871694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41f0c2669c040cdb38fddd33e015ec7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:52.873668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:52.923414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41f0c2669c040cdb38fddd33e015ec7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.924079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41f0c2669c040cdb38fddd33e015ec7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.936312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41f0c2669c040cdb38fddd33e015ec7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.943690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41f0c2669c040cdb38fddd33e015ec7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.952387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-af569ae5-9b6e-41e0-9603-f0eedd6a291f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41f0c2669c040cdb38fddd33e015ec7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:52.958329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1037/2063] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:52 2022] DELETE /identity/v3/users/a41f0c2669c040cdb38fddd33e015ec7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:53.229800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.231356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:53.252336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834cc-d24c-43ec-ba45-3d243f3ae586 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.315067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.315944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.316223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.316529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] PATH_INFO: `/v3/projects/34698c1c313c4375a691eeefdf5b0fab` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.317752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34698c1c313c4375a691eeefdf5b0fab)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.319659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.366954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34698c1c313c4375a691eeefdf5b0fab', 'request_id': 'req-c73161a2-956f-401d-8e2f-3abe8e095490'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:53.372408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34698c1c313c4375a691eeefdf5b0fab', 'request_id': 'req-c73161a2-956f-401d-8e2f-3abe8e095490'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:53.381215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34698c1c313c4375a691eeefdf5b0fab', 'request_id': 'req-c73161a2-956f-401d-8e2f-3abe8e095490'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:53.393034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] The token cache is being invalidate because project 34698c1c313c4375a691eeefdf5b0fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:37:53.393316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:53.394029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-c73161a2-956f-401d-8e2f-3abe8e095490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:53.395967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1027/2064] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:37:53 2022] DELETE /identity/v3/projects/34698c1c313c4375a691eeefdf5b0fab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:53.401026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.401494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.401656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.421869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:53.423381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:53.485005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1038/2065] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:53.493413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.493701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.493974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.513690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:53.515180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:53.524665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1028/2066] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:53.529367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.539387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20914-ad64-4a60-9f9f-61840fd9907c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.543908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.544593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.544870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.545144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.545878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:37:53.546182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.547786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.559414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1039/2067] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:37:53.564113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.574016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3a6f3-f59f-4e26-97b9-792b7981636e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.579638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.580287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.580591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.580859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.581556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.583551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.610413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1029/2068] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:53.614479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.624457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6b4e-0bfe-4dd9-999a-201b525cf0eb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.685402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.686075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.686354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.686628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.687326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.689278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.710267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1040/2069] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:37:53.714483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.725502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d9cb-cc2c-4b4f-8510-347040491e28 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.730990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.731689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.731970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.732244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.733015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.734962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.745917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1030/2070] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:53.751264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.762025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ef32-8be7-450f-a99c-4222c1652041 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.767661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.768310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.768634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.768914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.769641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.771355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e9fe5-1994-4106-b65d-9cd123a9136c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.781728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1041/2071] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:53.786126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:53.796751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6b1f-c29f-4650-8e32-b5343d647d54 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:53.802332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:53.803240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.803523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.804166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] PATH_INFO: `/v3/projects/e60b7e5cce104f02a851c7c4b7a14c7d/users/afe710fca71f4b0c84771b2b7dba3b8a/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.819383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60b7e5cce104f02a851c7c4b7a14c7d, user_id=afe710fca71f4b0c84771b2b7dba3b8a, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:53.822149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:53.836794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1031/2072] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:53 2022] PUT /identity/v3/projects/e60b7e5cce104f02a851c7c4b7a14c7d/users/afe710fca71f4b0c84771b2b7dba3b8a/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:53.848053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:53.848345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:53.848700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:53.876988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] MFA Rules not processed for user `afe710fca71f4b0c84771b2b7dba3b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:53.878811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:53.946394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1042/2073] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:53.952170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.012831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824c71-4d26-4804-9220-08c0c866e3b7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.017955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.018602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.018897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.019169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.019836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.022922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.057451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1032/2074] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:53 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:54.062531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.077905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6f36-1056-46fc-8caf-03867d2b3d0c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.134446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.135111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.135394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.135661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.136354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.138312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.163714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1043/2075] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:54 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:54.168015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.179145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ecc83-c4b2-48f7-a193-cdf514f2f57c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.184606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.185265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.185541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.185807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.186526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.188120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.199221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1033/2076] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:54.203229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.213493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14781d21-c41c-479e-8f2b-3f90c4ec3d0f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.219041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.219684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.219965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.220236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.221022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.222661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584963-6622-4f6f-843a-8cd8d2df484d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.232792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1044/2077] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:54.236878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.247470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82afdb-85d2-4766-b31f-80752fcff59d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.253275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.254167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.254449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.254744 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] PATH_INFO: `/v3/projects/e9239d2e02144a94bae93b496718d7b3/users/638a26f2a3174a779da3af52676ac135/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.270111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9239d2e02144a94bae93b496718d7b3, user_id=638a26f2a3174a779da3af52676ac135, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.272804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.287445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1034/2078] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:54 2022] PUT /identity/v3/projects/e9239d2e02144a94bae93b496718d7b3/users/638a26f2a3174a779da3af52676ac135/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:54.298158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.298450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.298726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.325813 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] MFA Rules not processed for user `638a26f2a3174a779da3af52676ac135`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:54.327037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:54.393347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1045/2079] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:37:54.397920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.462310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003a75-8723-4abd-9de3-666b43a47187 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.467368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.468037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.468326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.468623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.469320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.471214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.500348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1035/2080] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:37:54 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:54.504458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.515204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca79e1-ce8b-421b-8e56-9997ab5809a7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.575621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.576299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.576623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.576902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.577610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.580024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.603962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1046/2081] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:37:54 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:37:54.605277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.615794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8e545-9e0a-458e-b6ad-8e726dd09920 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.621691 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.622353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.622633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.622905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.623630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.625282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.636000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1036/2082] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:54.640325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.651164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30922-d097-49c8-a9e3-19ca604f0009 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.656847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.657735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.658016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.658304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] PATH_INFO: `/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8/users/00717ac46e614296832c501ac17e50a3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.674716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd7955f4cf84ca68b73c86cf5bea4c8, user_id=00717ac46e614296832c501ac17e50a3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.677524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.692357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1047/2083] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:54 2022] PUT /identity/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8/users/00717ac46e614296832c501ac17e50a3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:54.700898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.711894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f46-f08d-4e14-bbc6-536d33ccc79d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.777903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.778615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.778897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.779202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.779969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.781637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315bdb5-ee1d-41f9-9290-3c341ecca119 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.792998 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1037/2084] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:37:54.797125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.808621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14028f86-b3e8-4f20-8876-0355c92a10a6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:54.813824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:54.814698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.815001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.815266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] PATH_INFO: `/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8/users/00717ac46e614296832c501ac17e50a3/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.817419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd7955f4cf84ca68b73c86cf5bea4c8, user_id=00717ac46e614296832c501ac17e50a3, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:54.820600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:54.831243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1048/2085] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:37:54 2022] PUT /identity/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8/users/00717ac46e614296832c501ac17e50a3/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:54.842700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:54.842993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:54.843269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:54.872695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] MFA Rules not processed for user `00717ac46e614296832c501ac17e50a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:54.874346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:54.945671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1038/2086] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:54.959027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:54.961127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:55.020329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94b56-c445-46d2-a673-0cd11cdfe16b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:55.024476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:55.025148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:55.025447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:55.025718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:55.039177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:55.040662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:55.050388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1049/2087] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:55.101823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:55.103442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:55.116749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d08b-ae43-4c60-8ea1-d920f85e089f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:55.121693 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:55.122340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:55.122626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:55.122899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:55.182665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:55.184148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:55.193634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1039/2088] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:59.162836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:59.164661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:59.273487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256a16-7a58-40aa-bd9d-7b8776295d71 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:59.278754 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:59.281187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.281664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.282258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] PATH_INFO: `/v3/users/ed29c00637c2471cae8bda9ac3a396d8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.283497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed29c00637c2471cae8bda9ac3a396d8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:59.285771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:59.342427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:59.343858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:59.362454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed29c00637c2471cae8bda9ac3a396d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.363180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed29c00637c2471cae8bda9ac3a396d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.364053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d950-ed73-42e5-90d9-38dee2bca41d service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:59.372700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:59.373975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.374257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.374530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] PATH_INFO: `/v3/users/16c0b5750d4241a8a4ee95f6bfc00747` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.376039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c0b5750d4241a8a4ee95f6bfc00747)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:59.379349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:59.380257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed29c00637c2471cae8bda9ac3a396d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.389805 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed29c00637c2471cae8bda9ac3a396d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.415692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ea0697f2-62d2-4a89-b533-6d28b9f3e965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed29c00637c2471cae8bda9ac3a396d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.425680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1050/2089] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:59 2022] DELETE /identity/v3/users/ed29c00637c2471cae8bda9ac3a396d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:59.430830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.431363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.431785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.450352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:59.452040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:59.456239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c0b5750d4241a8a4ee95f6bfc00747'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.472644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c0b5750d4241a8a4ee95f6bfc00747'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.483005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c0b5750d4241a8a4ee95f6bfc00747'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.483970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c0b5750d4241a8a4ee95f6bfc00747'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.493140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-7ebf6c00-1eff-4501-8038-5135184143ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c0b5750d4241a8a4ee95f6bfc00747'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:37:59.502183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1040/2090] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:37:59 2022] DELETE /identity/v3/users/16c0b5750d4241a8a4ee95f6bfc00747 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:37:59.506770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.507125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.507436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.521461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1051/2091] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:59.528979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:59.530183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:59.534270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:59.535874 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:59.621766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241fb43-d2f5-494c-9640-5c0c7cd34e5a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:59.642768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1041/2092] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:37:59.653146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:37:59.703875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:59.705567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.705949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.706737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.722198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:59.723959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:59.736581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1052/2093] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:37:59.740303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176069b5-ba70-4fa0-94bf-841daec162e8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:37:59.752775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:37:59.753967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:59.754528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:59.754816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:59.766668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:37:59.768597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:37:59.782024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1042/2094] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:00.004459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.005888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.018415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af14b-bccf-46b7-9f6c-d6fe5f5d3c70 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.023461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.024510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.024691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.024968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] PATH_INFO: `/v3/users/39c57d6916864da1ac5a7ff39b0b1c27` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.026186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c57d6916864da1ac5a7ff39b0b1c27)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.028231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.095054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c57d6916864da1ac5a7ff39b0b1c27'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.095897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c57d6916864da1ac5a7ff39b0b1c27'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.111447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c57d6916864da1ac5a7ff39b0b1c27'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.120622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c57d6916864da1ac5a7ff39b0b1c27'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.131394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.133062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.138158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c57d6916864da1ac5a7ff39b0b1c27'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.149463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1053/2095] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/users/39c57d6916864da1ac5a7ff39b0b1c27 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.149709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4da3bb-df1d-4a1f-bf07-75f6993ecfc8 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.191265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.193436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.264578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.265701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.266177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.266558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] PATH_INFO: `/v3/projects/652bbf7a8bf842f6ae0f4798ef428e46` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.268358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcab7-da46-43ab-995b-af6fd00d7b90 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.269094 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652bbf7a8bf842f6ae0f4798ef428e46)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.272350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.273824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.274708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.274991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.275256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] PATH_INFO: `/v3/projects/c2fbed6c23aa4d8b83cf4c6d4c909de0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.276482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fbed6c23aa4d8b83cf4c6d4c909de0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.278885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.346128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652bbf7a8bf842f6ae0f4798ef428e46', 'request_id': 'req-05bccceb-5bac-4294-b08f-549aae55e0b1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.351390 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fbed6c23aa4d8b83cf4c6d4c909de0', 'request_id': 'req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.352593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652bbf7a8bf842f6ae0f4798ef428e46', 'request_id': 'req-05bccceb-5bac-4294-b08f-549aae55e0b1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.359108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fbed6c23aa4d8b83cf4c6d4c909de0', 'request_id': 'req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.363923 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652bbf7a8bf842f6ae0f4798ef428e46', 'request_id': 'req-05bccceb-5bac-4294-b08f-549aae55e0b1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.368557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fbed6c23aa4d8b83cf4c6d4c909de0', 'request_id': 'req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.377473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] The token cache is being invalidate because project 652bbf7a8bf842f6ae0f4798ef428e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:00.377977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.378956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.380927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1043/2096] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/projects/652bbf7a8bf842f6ae0f4798ef428e46 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.381987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.383790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.387051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] The token cache is being invalidate because project c2fbed6c23aa4d8b83cf4c6d4c909de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:00.387343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.388155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.390252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1054/2097] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/projects/c2fbed6c23aa4d8b83cf4c6d4c909de0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:00.391741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.396299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.464019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccceb-5bac-4294-b08f-549aae55e0b1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.470650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.470650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.470650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.471953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097bcc-8607-4cb1-9ee4-15c479b8e2f4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.473694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] PATH_INFO: `/v3/users/afe710fca71f4b0c84771b2b7dba3b8a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.474520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe710fca71f4b0c84771b2b7dba3b8a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.476476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.477699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.478612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.478897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.479175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] PATH_INFO: `/v3/users/e1b76ac1b0224a7ca05690c3626a678b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.480563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b76ac1b0224a7ca05690c3626a678b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.482410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.532736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe710fca71f4b0c84771b2b7dba3b8a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.535164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b76ac1b0224a7ca05690c3626a678b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.536310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b76ac1b0224a7ca05690c3626a678b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.544684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe710fca71f4b0c84771b2b7dba3b8a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.551316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b76ac1b0224a7ca05690c3626a678b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.552145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe710fca71f4b0c84771b2b7dba3b8a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.552902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe710fca71f4b0c84771b2b7dba3b8a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.559945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b76ac1b0224a7ca05690c3626a678b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.562812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-830bcc77-12e7-47a9-90f6-c46ad463145c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe710fca71f4b0c84771b2b7dba3b8a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.567623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b76ac1b0224a7ca05690c3626a678b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.570436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1044/2098] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/users/afe710fca71f4b0c84771b2b7dba3b8a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.572075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b3347-8239-48bd-bde7-368c8e2bc2d4 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.572622 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b3347-8239-48bd-bde7-368c8e2bc2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.573156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b3347-8239-48bd-bde7-368c8e2bc2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.573966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1055/2099] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/users/e1b76ac1b0224a7ca05690c3626a678b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.574759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.577688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.604008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-545b3347-8239-48bd-bde7-368c8e2bc2d4 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:00.606226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-545b3347-8239-48bd-bde7-368c8e2bc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.675110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b18c73-5107-41cf-8148-deef4d30f654 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.675110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.675110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.675110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.675908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] PATH_INFO: `/v3/projects/c0f3d3cb2e8b44f3976c17ee9adf25e6` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.677297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f3d3cb2e8b44f3976c17ee9adf25e6)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.679738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.680430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1045/2100] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:00.682612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5db1-8a41-4e0b-8e6a-3a117edbf742 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.683068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5db1-8a41-4e0b-8e6a-3a117edbf742 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.683392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5db1-8a41-4e0b-8e6a-3a117edbf742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.702477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6f0c5db1-8a41-4e0b-8e6a-3a117edbf742 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:00.703682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6f0c5db1-8a41-4e0b-8e6a-3a117edbf742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.711738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1046/2101] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:00.713167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.713449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.713723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.737192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:00.738176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f3d3cb2e8b44f3976c17ee9adf25e6', 'request_id': 'req-c8565029-f4de-46d3-afc0-4a16da3118e1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.738387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.745413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f3d3cb2e8b44f3976c17ee9adf25e6', 'request_id': 'req-c8565029-f4de-46d3-afc0-4a16da3118e1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.757778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f3d3cb2e8b44f3976c17ee9adf25e6', 'request_id': 'req-c8565029-f4de-46d3-afc0-4a16da3118e1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.770536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] The token cache is being invalidate because project c0f3d3cb2e8b44f3976c17ee9adf25e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:00.770822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.771850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.773683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1056/2102] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/projects/c0f3d3cb2e8b44f3976c17ee9adf25e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.776703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.776703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.807066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1047/2103] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:00.808059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.809709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.821595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87513b8-9e36-453e-a8e7-8a0e5d0b89fe None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.827310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.828664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.828948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.829215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] PATH_INFO: `/v3/users/eb94b3d90b914bed9d415ef0c889d4e3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.830859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb94b3d90b914bed9d415ef0c889d4e3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.833082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.837089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8565029-f4de-46d3-afc0-4a16da3118e1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.843730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.844510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.844807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.845070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.848033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.862909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.864765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.880407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1057/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:00.880407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.891678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a830ce-9714-4d06-b380-37ad257252ae service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:00.897035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb94b3d90b914bed9d415ef0c889d4e3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.897797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:00.898993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:00.899267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:00.899814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:00.900606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:00.900917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:00.908809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:00.915168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb94b3d90b914bed9d415ef0c889d4e3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.922799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb94b3d90b914bed9d415ef0c889d4e3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.923626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb94b3d90b914bed9d415ef0c889d4e3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.930775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1058/2105] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:00.931748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.933701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.936104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb94b3d90b914bed9d415ef0c889d4e3'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:00.943833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1048/2106] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/users/eb94b3d90b914bed9d415ef0c889d4e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:00.947895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:00.949334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:00.950580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3fe91-8f57-430a-9302-e3bc9ecc7bc5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.022960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.024251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.024748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.025026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] PATH_INFO: `/v3/projects/8e96129d8c754173be98c726bb8982da` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.026220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e96129d8c754173be98c726bb8982da)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.028921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.032556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ec68e-90cf-4274-b5e9-d244a8076069 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.045076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.045926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.046307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.046780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.047692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.049871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.095232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1049/2107] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:00 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:01.098139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e96129d8c754173be98c726bb8982da', 'request_id': 'req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.099510 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.106572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e96129d8c754173be98c726bb8982da', 'request_id': 'req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.119416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e96129d8c754173be98c726bb8982da', 'request_id': 'req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.137725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] The token cache is being invalidate because project 8e96129d8c754173be98c726bb8982da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:01.138429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.138983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf06cedd-49b5-4008-96bb-1a10d0a29cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.141738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1059/2108] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:00 2022] DELETE /identity/v3/projects/8e96129d8c754173be98c726bb8982da => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:01.147148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.147601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.148016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.169201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:01.170654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.188040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea989-bb42-4458-bef9-a018203252a5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.202596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.203539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.203959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.204381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.205250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.207513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.229382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1050/2109] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:01.230304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.232343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.246742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15ac4d-2245-4b7f-a780-851d2abc4319 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.248550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1060/2110] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:01.249465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.250866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.261166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.262652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.263038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.263314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] PATH_INFO: `/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.264083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09719-ec78-4811-8615-bc397a447c43 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.264549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4fa1da43b6458eaf302e875dbe7edf)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.266467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.268740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.269674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.269941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.270217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] PATH_INFO: `/v3/projects/e60b7e5cce104f02a851c7c4b7a14c7d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.271457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60b7e5cce104f02a851c7c4b7a14c7d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.273451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.313675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4fa1da43b6458eaf302e875dbe7edf', 'request_id': 'req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.318885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4fa1da43b6458eaf302e875dbe7edf', 'request_id': 'req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.319221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60b7e5cce104f02a851c7c4b7a14c7d', 'request_id': 'req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.324729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60b7e5cce104f02a851c7c4b7a14c7d', 'request_id': 'req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.326052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4fa1da43b6458eaf302e875dbe7edf', 'request_id': 'req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.332456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60b7e5cce104f02a851c7c4b7a14c7d', 'request_id': 'req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.337957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] The token cache is being invalidate because project 2c4fa1da43b6458eaf302e875dbe7edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:01.338249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.338888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.340476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1051/2111] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:01 2022] DELETE /identity/v3/projects/2c4fa1da43b6458eaf302e875dbe7edf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:01.343699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] The token cache is being invalidate because project e60b7e5cce104f02a851c7c4b7a14c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:01.344109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.344607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.344931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d9cb00ee-1bc4-4565-b4a0-d2a42c44b344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.345931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.346618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1061/2112] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:01 2022] DELETE /identity/v3/projects/e60b7e5cce104f02a851c7c4b7a14c7d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:01.348111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d11b-dc63-4fe2-a94e-49b2dde1befb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.348498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d11b-dc63-4fe2-a94e-49b2dde1befb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.348864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d11b-dc63-4fe2-a94e-49b2dde1befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.366799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3a22d11b-dc63-4fe2-a94e-49b2dde1befb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:01.367674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a22d11b-dc63-4fe2-a94e-49b2dde1befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.415377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0f81f-82b6-49b5-bafe-0ea6af3d475d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.430473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1062/2113] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:01.433951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.433951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.433951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.450812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:01.452006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.461446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1063/2114] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:01.462383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.463793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.475587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef674012-e364-4aff-9d3b-9e956236a5d7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.482798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.483413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.483637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.483943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.484093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.484188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] PATH_INFO: `/v3/users/638a26f2a3174a779da3af52676ac135` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.484529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.484789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.485430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638a26f2a3174a779da3af52676ac135)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.485536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.487185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.487357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.498087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1052/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:01.499075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.510423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf485-ee4e-4949-b40b-604814eceb8e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.515705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.516370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.516726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.517007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.517815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:01.518118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.520118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1fb70-09e6-46cb-b752-667c8575ffde admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.534297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1053/2116] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:01.535608 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.535887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.536159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.538223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638a26f2a3174a779da3af52676ac135'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.538912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638a26f2a3174a779da3af52676ac135'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.551705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638a26f2a3174a779da3af52676ac135'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.555863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:01.557434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.559244 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638a26f2a3174a779da3af52676ac135'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.569195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1054/2117] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:01.569195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.569427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638a26f2a3174a779da3af52676ac135'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:01.569508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.574730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1064/2118] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:01 2022] DELETE /identity/v3/users/638a26f2a3174a779da3af52676ac135 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:01.575501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.576924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.585931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564852-c713-412a-84d7-416bfe6f7635 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.648486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1f51c-a209-4f5b-974c-34032ac78414 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.650713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.651415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.651716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.651993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.652763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.653728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.654387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.654488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.654658 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.654928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.655628 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.657847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.681680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1055/2119] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:01.683038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.699206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1065/2120] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:01.699861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb3f65-76b7-4c68-8510-54449adca001 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.704404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.776212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e668-da98-4026-8b9f-efae414895bc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.782903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.783705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.784152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.784782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.784968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.785185 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.785662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.785794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] PATH_INFO: `/v3/projects/4574cc6d1aed4565aca93abf1689e4e7/users/87c1ec536af248008efa9e06d4cdd041/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.786767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:01.787047 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.788788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.800580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1056/2121] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:01.801511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.805341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4574cc6d1aed4565aca93abf1689e4e7, user_id=87c1ec536af248008efa9e06d4cdd041, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.808344 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.816474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433efc-c16b-4b15-8d3e-ac83635cd874 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.823264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1066/2122] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:01 2022] PUT /identity/v3/projects/4574cc6d1aed4565aca93abf1689e4e7/users/87c1ec536af248008efa9e06d4cdd041/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:01.823867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.889493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.890238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.890661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.891072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.891908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.894013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faafdc-74cc-4af2-bc78-9ef6eda62818 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.917328 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1057/2123] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:01.918942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.919267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.919610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.922842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9f30-741b-478a-8f72-66cde6e83a98 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:01.932529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:01.933214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:01.933493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:01.933770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:01.934532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:01.937406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:01.947010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] MFA Rules not processed for user `87c1ec536af248008efa9e06d4cdd041`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:01.948232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:01.966154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1067/2124] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:01.966154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:01.966154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.018880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1058/2125] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:02.019839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.032175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e7abb-310e-4183-8bf3-a88492fb8ee1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.037221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.037423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254533-19f6-4417-8286-8e13b594d0b4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.037846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.038061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.038332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.039070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.040689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.042252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.043227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.043618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.043989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] PATH_INFO: `/v3/projects/e9239d2e02144a94bae93b496718d7b3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.045421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9239d2e02144a94bae93b496718d7b3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.047455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.054407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1059/2126] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.054407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.063946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb1a0-9754-47e0-9473-2822e01df2f6 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.068897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.069554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.069831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.070100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.070815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.072730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.095193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1060/2127] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:02.096413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.097414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9239d2e02144a94bae93b496718d7b3', 'request_id': 'req-fe95c6a0-1ace-4d45-baea-75a4d96822f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.103266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9239d2e02144a94bae93b496718d7b3', 'request_id': 'req-fe95c6a0-1ace-4d45-baea-75a4d96822f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.106419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa2a2-dc5c-4679-8bba-b247f7b54d98 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.111389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9239d2e02144a94bae93b496718d7b3', 'request_id': 'req-fe95c6a0-1ace-4d45-baea-75a4d96822f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.122505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] The token cache is being invalidate because project e9239d2e02144a94bae93b496718d7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:02.122792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.123461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.125094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1068/2128] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:01 2022] DELETE /identity/v3/projects/e9239d2e02144a94bae93b496718d7b3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.125983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.127315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.177514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.178631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.179017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.179288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.179981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.181978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.201957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95c6a0-1ace-4d45-baea-75a4d96822f1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.207389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.208065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.208346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.208703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.209438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.211081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.211827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1061/2129] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:02.212688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.214461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.223422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1069/2130] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.224404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.227575 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.240632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cb55-e4dc-46e1-9338-a4b76a689fa9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.278479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7b825-e6e2-4352-a168-de2623ab20ba admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.283465 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.284145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.284427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.284710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.285448 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.287067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.297018 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1062/2131] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.297736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.298212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.299340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.299598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.300084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.300205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] PATH_INFO: `/v3/users/00717ac46e614296832c501ac17e50a3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.301624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00717ac46e614296832c501ac17e50a3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.303980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.312108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e251-49b9-481f-a39d-f8462ad5faf3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.316975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.317634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.317886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.318181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.318858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.320772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.344367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1063/2132] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:02.345494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.353741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00717ac46e614296832c501ac17e50a3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.354409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00717ac46e614296832c501ac17e50a3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.354966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2371ae7-0a47-42bf-8503-7341bba01322 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.360561 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.361432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.361721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.361994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] PATH_INFO: `/v3/projects/4bdccf12e38845e0a8457f6f806fa4a7/users/eab35a4e11694744a86ae0b0e2fad907/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.365968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00717ac46e614296832c501ac17e50a3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.372869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00717ac46e614296832c501ac17e50a3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.377972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdccf12e38845e0a8457f6f806fa4a7, user_id=eab35a4e11694744a86ae0b0e2fad907, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.380931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.381138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00717ac46e614296832c501ac17e50a3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.388495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1070/2133] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:02 2022] DELETE /identity/v3/users/00717ac46e614296832c501ac17e50a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.392058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.393547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.394170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1064/2134] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:02 2022] PUT /identity/v3/projects/4bdccf12e38845e0a8457f6f806fa4a7/users/eab35a4e11694744a86ae0b0e2fad907/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.394968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.397627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.466757 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73271c4-89c2-426b-86a0-f0bc6e3f140e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.471839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.472546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.472922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.473202 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.473952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.475632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bd2d7-24b8-4c0b-8017-dadc5917f0b8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.477234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bfbd-3163-4594-b7b3-2dc9e812d536 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.482593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.483401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.483690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.484115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.484742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.486358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.486770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1065/2135] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.488088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.488398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.488706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.508377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1071/2136] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.508377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.519319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] MFA Rules not processed for user `eab35a4e11694744a86ae0b0e2fad907`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:02.520963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.521267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f75954-9374-4cfc-b1d9-3f6053b7d90c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.527017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.527936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.528217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.528534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] PATH_INFO: `/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440/users/27eaee1f60d14b1482c79976440f971f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.547817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34a8b3d4b704c1da7c6b8dd74675440, user_id=27eaee1f60d14b1482c79976440f971f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.550520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.564540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1072/2137] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:02 2022] PUT /identity/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440/users/27eaee1f60d14b1482c79976440f971f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.568263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.596205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1066/2138] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:02.597089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.608309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d7d01-e0de-4dee-98cb-1c8d29af45fe None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.643674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0673-2ba5-42d4-a986-7c0c79ef21ea admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.650591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.651503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.651784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.652163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] PATH_INFO: `/v3/projects/bf21a099d07c42639d4ce684a4f40ed8/users/84c59f7cd9dc478388802071ea4dcc2f/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.665184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.665868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.666151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.666514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.667300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.668943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.676268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf21a099d07c42639d4ce684a4f40ed8, user_id=84c59f7cd9dc478388802071ea4dcc2f, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.679567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1067/2139] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:02.679721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.680377 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.682027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.695165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1073/2140] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:02 2022] PUT /identity/v3/projects/bf21a099d07c42639d4ce684a4f40ed8/users/84c59f7cd9dc478388802071ea4dcc2f/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.696005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.759286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e5d7-c748-4ffa-bc3b-2f1e8994c2b3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.777054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4c790-5ba4-4a6a-906e-b1ddb5a9c35f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.782518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.783421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.783714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.783987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] PATH_INFO: `/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440/users/27eaee1f60d14b1482c79976440f971f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.787377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34a8b3d4b704c1da7c6b8dd74675440, user_id=27eaee1f60d14b1482c79976440f971f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.790109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.800463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1074/2141] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:02 2022] PUT /identity/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440/users/27eaee1f60d14b1482c79976440f971f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.805291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:02.807341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.813550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.814205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.814482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.814750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.875829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99bf22-8ac5-4c94-982a-f81ce1c6c763 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:02.879082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.880511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:02.880639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6b209-11a3-4535-a0a4-d8f9e06ca03b service glance] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.881363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.881646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.882361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] PATH_INFO: `/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.883554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd7955f4cf84ca68b73c86cf5bea4c8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:02.885481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:02.889828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1068/2142] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:02.891114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680493-c7df-4fe6-9cdc-cd25c251c4e9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.891408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680493-c7df-4fe6-9cdc-cd25c251c4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.891734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680493-c7df-4fe6-9cdc-cd25c251c4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.920005 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5a680493-c7df-4fe6-9cdc-cd25c251c4e9 None None] MFA Rules not processed for user `84c59f7cd9dc478388802071ea4dcc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:02.921268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5a680493-c7df-4fe6-9cdc-cd25c251c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:02.935933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd7955f4cf84ca68b73c86cf5bea4c8', 'request_id': 'req-b79f7a32-3f2a-4dd0-887a-e879a46f382f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.941152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd7955f4cf84ca68b73c86cf5bea4c8', 'request_id': 'req-b79f7a32-3f2a-4dd0-887a-e879a46f382f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.949267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd7955f4cf84ca68b73c86cf5bea4c8', 'request_id': 'req-b79f7a32-3f2a-4dd0-887a-e879a46f382f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.960695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] The token cache is being invalidate because project 3cd7955f4cf84ca68b73c86cf5bea4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:02.961127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.961913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79f7a32-3f2a-4dd0-887a-e879a46f382f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:02.963518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1075/2143] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:02 2022] DELETE /identity/v3/projects/3cd7955f4cf84ca68b73c86cf5bea4c8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:02.964783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.965168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.965334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.989488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1069/2144] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:02.989488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bedc-6073-4395-89c9-9cbf1bb7c7e9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:02.989488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bedc-6073-4395-89c9-9cbf1bb7c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:02.989488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bedc-6073-4395-89c9-9cbf1bb7c7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:02.994059 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] MFA Rules not processed for user `27eaee1f60d14b1482c79976440f971f`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:02.995229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.011447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5ac5bedc-6073-4395-89c9-9cbf1bb7c7e9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:03.013457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5ac5bedc-6073-4395-89c9-9cbf1bb7c7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.074612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1076/2145] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:03.075777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.077186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1070/2146] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:03.078120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.085924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.086208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.086463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.104645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:03.105941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.118102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1071/2147] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:03.119172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.129412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db57f1-0568-4709-b687-ac80dd66c35f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.135145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.135811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.136103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.136378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.137351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:03.137460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.139067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.143676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963585-5790-42a2-b789-6f973a0b01e9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.148827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.149661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.150037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.150426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.152473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1072/2148] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:03.156542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.162868 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.164395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.167007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68ee67-5e8a-40c9-b628-8817a101759d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.171974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.172599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.172902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.173273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.174026 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.176017 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1077/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:03.177694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.209558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1073/2150] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:03 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:03.214054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.226305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ceb29-bd9e-46e3-bfb5-aa8fb85b35ce service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.282124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.282856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.283134 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.283404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.284102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.286234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.308641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1078/2151] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:03 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:03.313065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.324160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bb3c-00e0-4946-90b2-06357be7021c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.330660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.331570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.331891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.332255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.333065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.335133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.348799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1074/2152] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:03.353172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.361372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.363397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.371519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807f63-f8df-4053-9234-6ba932a25437 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.376683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.377518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.377742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.378012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.378796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.380715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.392079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1079/2153] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:03.396359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.406947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf3e99-03ca-448a-bcf7-6aa2a40d6215 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.416623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.417944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.418056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.418304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] PATH_INFO: `/v3/projects/3e942908320b4929b80c17d229631c60/users/04a3d6f42c9848c2aad762375ae1a262/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.433275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849d84-256f-445b-a310-5d6dc374d2f8 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.437154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e942908320b4929b80c17d229631c60, user_id=04a3d6f42c9848c2aad762375ae1a262, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.437425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.438087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.438368 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.438700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.439890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b5192-f764-4d57-8ee5-68ca32d26695 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.440978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.473346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1080/2154] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:03 2022] PUT /identity/v3/projects/3e942908320b4929b80c17d229631c60/users/04a3d6f42c9848c2aad762375ae1a262/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:03.485683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.486423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.486745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.519567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] MFA Rules not processed for user `04a3d6f42c9848c2aad762375ae1a262`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:03.520985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:03.531828 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.533337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.544909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1075/2155] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:03.604751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1081/2156] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:03.616193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.624582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d299-dd3b-4f3d-b916-3e0883215c3d service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.679038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.679699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.679986 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.680257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.689630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.691072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661672-320f-4e26-89e4-178d062d6625 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.700069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1076/2157] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:03.719049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:03.783440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e909-2bad-4117-b701-6ae21660d4f7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:03.799987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:03.801003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.801573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.801826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] PATH_INFO: `/v3/users/04a3d6f42c9848c2aad762375ae1a262` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.803692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a3d6f42c9848c2aad762375ae1a262)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:03.806352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:03.873073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a3d6f42c9848c2aad762375ae1a262'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:03.881788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a3d6f42c9848c2aad762375ae1a262'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:03.923591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a3d6f42c9848c2aad762375ae1a262'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:03.939653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a3d6f42c9848c2aad762375ae1a262'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:03.950616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a3d6f42c9848c2aad762375ae1a262'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:03.959137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1082/2158] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:03 2022] DELETE /identity/v3/users/04a3d6f42c9848c2aad762375ae1a262 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:03.964109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:03.964541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:03.964793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:03.993308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:03.994529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.054154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1077/2159] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:04.064521 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.066809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.131929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b24ff-f3c1-403b-a742-2ee2da4b4c4a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.135680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:04.136327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.136634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.136912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.146497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:04.148420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:04.159408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1083/2160] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:04.442776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.444703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.465300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6e8f-d341-4dc0-bdc0-846f81727d8b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.473068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:04.473959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.474239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.474507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] PATH_INFO: `/v3/projects/3e942908320b4929b80c17d229631c60` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.475705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e942908320b4929b80c17d229631c60)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:04.477639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:04.527785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e942908320b4929b80c17d229631c60', 'request_id': 'req-d4114c66-1d57-4ecd-9622-ddbf30655819'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.534214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e942908320b4929b80c17d229631c60', 'request_id': 'req-d4114c66-1d57-4ecd-9622-ddbf30655819'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.543287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e942908320b4929b80c17d229631c60', 'request_id': 'req-d4114c66-1d57-4ecd-9622-ddbf30655819'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.571101 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] The token cache is being invalidate because project 3e942908320b4929b80c17d229631c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:04.571343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.571812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.571812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d4114c66-1d57-4ecd-9622-ddbf30655819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.573810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.575032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1078/2161] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:04 2022] DELETE /identity/v3/projects/3e942908320b4929b80c17d229631c60 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:04.580868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4f1-0f2d-4510-bd89-23171025e274 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.581701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4f1-0f2d-4510-bd89-23171025e274 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.582185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4f1-0f2d-4510-bd89-23171025e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.592786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555c5a-c78e-4e4e-8ed0-44fa2dbf2430 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.604097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-202be4f1-0f2d-4510-bd89-23171025e274 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:04.605334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-202be4f1-0f2d-4510-bd89-23171025e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.674028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:04.675124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.675553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.676747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] PATH_INFO: `/v3/users/0f2fd6d77aa949d5b5919432cb722b37` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.678927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2fd6d77aa949d5b5919432cb722b37)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:04.681426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:04.681950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1079/2162] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:04.690974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.691385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.691670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.711743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:04.712979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.721682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1080/2163] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:04.726267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.733802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2fd6d77aa949d5b5919432cb722b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.734606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2fd6d77aa949d5b5919432cb722b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.736614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfb08-9f9c-4ca5-822f-752aa9231e3a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.741388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:04.742075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.742361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.742637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.743371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:04.743680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:04.747544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2fd6d77aa949d5b5919432cb722b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.755033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:04.755782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2fd6d77aa949d5b5919432cb722b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.768192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2fd6d77aa949d5b5919432cb722b37'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:04.776035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1084/2164] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:04 2022] DELETE /identity/v3/users/0f2fd6d77aa949d5b5919432cb722b37 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:04.786293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1081/2165] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:38:04.790761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.792100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:04.869470 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ec82-df6d-4a55-8128-5ce68dd8d437 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.875188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:04.876256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:04.876593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:04.876862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:04.878056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:04.880638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:04.910949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1085/2166] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:04.915363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.926306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e079-51cf-4efa-86aa-4e2eea113322 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:04.982430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:04.984395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.017085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.017870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.018223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.018576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.020659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.022173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.050702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1082/2167] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:04 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:05.055596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.066272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9f3f7-9785-4018-b4c3-3bc7e3963354 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.072582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.073816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.073816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.074136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.074955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.076917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.089426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1083/2168] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:05.092146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3908-5ed3-466c-9ba9-a55242e4bea6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.093672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.098299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.099249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.099533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.099812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] PATH_INFO: `/v3/projects/17c116936d14470bb13850d6b8c83f8e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.101254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c116936d14470bb13850d6b8c83f8e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.103187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.105976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ceb48-f7ce-433a-a9c7-aecaf72ddbdd admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.115532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.116337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.116755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.118079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.119351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.121281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.136320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1084/2169] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:05.140072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.151011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6096195-8ebc-4076-87ee-567611c6d70b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.158717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c116936d14470bb13850d6b8c83f8e', 'request_id': 'req-0c338004-7c4b-47cc-ab6b-e77bae9858a4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:05.164391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c116936d14470bb13850d6b8c83f8e', 'request_id': 'req-0c338004-7c4b-47cc-ab6b-e77bae9858a4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:05.174205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c116936d14470bb13850d6b8c83f8e', 'request_id': 'req-0c338004-7c4b-47cc-ab6b-e77bae9858a4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:05.186308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] The token cache is being invalidate because project 17c116936d14470bb13850d6b8c83f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:05.186693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:05.187441 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0c338004-7c4b-47cc-ab6b-e77bae9858a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:05.189109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1086/2170] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:04 2022] DELETE /identity/v3/projects/17c116936d14470bb13850d6b8c83f8e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:05.194278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be058-020b-4133-9e56-60c46256254d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.194570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be058-020b-4133-9e56-60c46256254d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.194853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be058-020b-4133-9e56-60c46256254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.215349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.215779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ad5be058-020b-4133-9e56-60c46256254d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:05.216408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.216719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.217048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ad5be058-020b-4133-9e56-60c46256254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.217154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] PATH_INFO: `/v3/projects/799e3b06011e4d36ad0c020e3a261a9f/users/f8cb6ae1c05a4be0bf4b6a09c6edd55e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.225961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1087/2171] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:05.231977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799e3b06011e4d36ad0c020e3a261a9f, user_id=f8cb6ae1c05a4be0bf4b6a09c6edd55e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.233949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44969ce-3877-45be-9341-500937caf75a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.234238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44969ce-3877-45be-9341-500937caf75a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.234515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44969ce-3877-45be-9341-500937caf75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.237502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc2c0b-6781-420a-80d1-1163d2153f80 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.259849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1085/2172] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:05 2022] PUT /identity/v3/projects/799e3b06011e4d36ad0c020e3a261a9f/users/f8cb6ae1c05a4be0bf4b6a09c6edd55e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:05.261650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a44969ce-3877-45be-9341-500937caf75a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:05.262117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.262464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.262803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.262924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a44969ce-3877-45be-9341-500937caf75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.291882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] MFA Rules not processed for user `f8cb6ae1c05a4be0bf4b6a09c6edd55e`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:05.293278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.325750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1088/2173] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:05.330050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44969ce-3877-45be-9341-500937caf75a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.339665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44969ce-3877-45be-9341-500937caf75a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.344279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.344995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.345297 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.345568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.349706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:05.349706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.349706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.360630 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1089/2174] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:38:05.364743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.374778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48d3f-ec6b-44e4-bab8-f6753d4c64d2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.380298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.380992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.381288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.381547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.382213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.384729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.387167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1086/2175] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:05.392164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.393657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.407589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5e8b5-0005-49a5-b9f7-85818391f8f8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.412824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.413417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.413704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.413978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.414672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.416604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.420494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1090/2176] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:05.422164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.450477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1087/2177] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:05.451481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.490438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccb8e3-57a9-475d-b108-564c0f7a2724 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.516420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869b81-43fb-4a00-bf82-974784c2d26d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.523311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.523988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.524270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.524578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.525272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.527192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.548551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1088/2178] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:05.552284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.555688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.556378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.556697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.556975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.557674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.559601 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.562090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396ca-0d90-4632-8fb6-410b7cc95974 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.566780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.567438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.567717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.567996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.568767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.570336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.584535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1091/2179] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:05.585660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.589059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1089/2180] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:05.593208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.595829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f425039-5cc6-49b4-b009-5ff64941bc15 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.600420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.601115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.601398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.601676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.602536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.604366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.607308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a088b-bc5c-4fa9-93ce-99b66c0c7230 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.613102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.613768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.614052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.614402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.614879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1092/2181] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:38:05.616899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.618516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.618624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.628093 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94126-f6b4-4671-9047-e33eb9765476 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.632262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1090/2182] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:05.633255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.633382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.634018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.634238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.634518 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.635243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.636962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.642623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b3bc9-143d-4eac-97b9-2650ce667f19 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.647704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.648265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1093/2183] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:38:05.648783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.649167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.649503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] PATH_INFO: `/v3/projects/53fa73af1c3146e2ad08eb3d93445b82/users/232ed51a32144303bbef0ad29d7c2d11/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.652408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.662298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364b04-14d6-48cb-87cb-5378f2cfcc4b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.664604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fa73af1c3146e2ad08eb3d93445b82, user_id=232ed51a32144303bbef0ad29d7c2d11, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.667035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.667227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604005d-7c36-45eb-8240-f65155b3a94f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.667921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.668205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.668503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] PATH_INFO: `/v3/projects/69e39fae43c341798f00e3b48f20d003/users/20c57f1318cd4c73b2248b2d02896176/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.681292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1091/2184] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:05 2022] PUT /identity/v3/projects/53fa73af1c3146e2ad08eb3d93445b82/users/232ed51a32144303bbef0ad29d7c2d11/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:05.683343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e39fae43c341798f00e3b48f20d003, user_id=20c57f1318cd4c73b2248b2d02896176, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.686070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232be80-8581-449f-b255-d15e1fb7e814 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.691954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.692450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.692936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.700080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1094/2185] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:05 2022] PUT /identity/v3/projects/69e39fae43c341798f00e3b48f20d003/users/20c57f1318cd4c73b2248b2d02896176/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:05.705202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.705674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.705955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.719028 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] MFA Rules not processed for user `232ed51a32144303bbef0ad29d7c2d11`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:05.720249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.723479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:05.724683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.781483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1092/2186] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:05.783327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1095/2187] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:05.787627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.792935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.794431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:05.798233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef8c45-3544-4782-9c41-121491463bc8 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.803289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.803942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.804224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.804513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.805236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.807134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.835282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1093/2188] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:05.836313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.851555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f9d7-27ee-4430-a02c-673cdf36d6ec None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.897868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06721761-1fb8-477c-ae40-c156180043b5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.902162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.902604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.902817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.903097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.903270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.903364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.903549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.903821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.904532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.906454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.912559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.914030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.924373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1096/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:05.928581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1094/2190] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:05 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:05.932501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.942205 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dc36-267b-4cc4-be14-890cbee396ea service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.947426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.948170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.948559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.948866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.949593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.951195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:05.961246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1097/2191] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:05.965426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:05.975529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac2fa-810b-4bc1-a5f2-d3ddf3896951 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:05.980302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:05.981228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:05.981503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:05.981771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] PATH_INFO: `/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9/users/30aafabedef34a2b9062256e9311e761/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:05.996700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d7f91dcbe34a97a42515e84680dcd9, user_id=30aafabedef34a2b9062256e9311e761, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:05.999374 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:06.012635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1095/2192] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:05 2022] PUT /identity/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9/users/30aafabedef34a2b9062256e9311e761/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:06.017070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:06.027856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467261-28b7-4a43-8e3e-d863f171c715 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:06.095662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:06.096954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:06.097491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:06.097978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:06.098945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:06.100893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f344-edf5-4781-bc08-944b8e9a4eab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:06.111753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1098/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:06.116528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:06.127987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7d43c-00cc-45b5-bf94-75560fe6e461 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:06.134652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:06.135638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:06.135926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:06.136205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] PATH_INFO: `/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9/users/30aafabedef34a2b9062256e9311e761/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:06.138302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d7f91dcbe34a97a42515e84680dcd9, user_id=30aafabedef34a2b9062256e9311e761, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:06.141014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:06.153035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1096/2194] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:06 2022] PUT /identity/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9/users/30aafabedef34a2b9062256e9311e761/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:06.165094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:06.165305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:06.165590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:06.196216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] MFA Rules not processed for user `30aafabedef34a2b9062256e9311e761`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:06.197535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:06.268905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1099/2195] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:06.280558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:06.282635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:06.344351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836c36f-2353-4754-a77f-68dca242ff88 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:06.348113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:06.348799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:06.349080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:06.349354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:06.406855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:06.408352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b597fc-2492-4309-880d-fb130abfb158 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:06.417499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1097/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:08.276665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:08.279885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:08.395049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89c0e-8d27-4b82-ae14-370a7935122b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:08.403979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:08.405507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:08.405870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:08.406214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] PATH_INFO: `/v3/users/87c1ec536af248008efa9e06d4cdd041` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:08.407778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c1ec536af248008efa9e06d4cdd041)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:08.410052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:08.490406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c1ec536af248008efa9e06d4cdd041'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:08.491394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c1ec536af248008efa9e06d4cdd041'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:08.515178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c1ec536af248008efa9e06d4cdd041'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:08.525339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c1ec536af248008efa9e06d4cdd041'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:08.538288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c1ec536af248008efa9e06d4cdd041'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:08.546106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1100/2197] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:08 2022] DELETE /identity/v3/users/87c1ec536af248008efa9e06d4cdd041 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:08.550936 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:08.552052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:08.552524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:08.579009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:08.583450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:08.690709 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1098/2198] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:08.700677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:08.702528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:08.789348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52c9a7-b65c-4c86-a6c8-0b9b068ae420 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:08.797442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:08.798182 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:08.798536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:08.799127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:08.837904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:08.838352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:08.863057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1101/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:09.150837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:09.152421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:09.257488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22d05-152a-4905-9f76-9a607bbb0b5e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:09.269737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:09.270724 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:09.271358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:09.271734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:09.290841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:09.320829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:09.323568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:09.343334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390694f-6b80-4d44-bd9f-30764d20c704 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:09.356331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:09.357221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:09.357506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:09.357930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] PATH_INFO: `/v3/projects/4574cc6d1aed4565aca93abf1689e4e7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:09.359446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4574cc6d1aed4565aca93abf1689e4e7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:09.361406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:09.428188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:09.429357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:09.440763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1099/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:09.448127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4574cc6d1aed4565aca93abf1689e4e7', 'request_id': 'req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.456672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4574cc6d1aed4565aca93abf1689e4e7', 'request_id': 'req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.465804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4574cc6d1aed4565aca93abf1689e4e7', 'request_id': 'req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.478873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] The token cache is being invalidate because project 4574cc6d1aed4565aca93abf1689e4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:09.479563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.480469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.482382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1102/2201] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:09 2022] DELETE /identity/v3/projects/4574cc6d1aed4565aca93abf1689e4e7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:09.487128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:09.501992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41201f4-520b-400a-aea0-092877d31048 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:09.582949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:09.583783 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:09.584034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:09.584317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] PATH_INFO: `/v3/users/27eaee1f60d14b1482c79976440f971f` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:09.585880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27eaee1f60d14b1482c79976440f971f)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:09.589477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:09.692090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27eaee1f60d14b1482c79976440f971f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.711822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27eaee1f60d14b1482c79976440f971f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.732118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27eaee1f60d14b1482c79976440f971f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.733003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27eaee1f60d14b1482c79976440f971f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.749705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27eaee1f60d14b1482c79976440f971f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:09.757866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1100/2202] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:09 2022] DELETE /identity/v3/users/27eaee1f60d14b1482c79976440f971f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:09.960797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:09.962177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:09.985711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9678b9-d2ea-47df-abac-77d8c84ee6d2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:10.119905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:10.121722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:10.122107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:10.122494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] PATH_INFO: `/v3/users/6ddac0afeee34b1e83b1dd3a2b92f0ab` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:10.125164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddac0afeee34b1e83b1dd3a2b92f0ab)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:10.127373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:10.224674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddac0afeee34b1e83b1dd3a2b92f0ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.225448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddac0afeee34b1e83b1dd3a2b92f0ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.239173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:10.239668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddac0afeee34b1e83b1dd3a2b92f0ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.240904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:10.247888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddac0afeee34b1e83b1dd3a2b92f0ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.255777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c068-43d2-4d44-8af6-68c7c3c69b4b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:10.258971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d235f2c4-d427-4b38-b36a-e07cc451f0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddac0afeee34b1e83b1dd3a2b92f0ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.264367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:10.265226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:10.265520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:10.265800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] PATH_INFO: `/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:10.267067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1103/2203] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:09 2022] DELETE /identity/v3/users/6ddac0afeee34b1e83b1dd3a2b92f0ab => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:10.271709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:10.272232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:10.272597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:10.274264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34a8b3d4b704c1da7c6b8dd74675440)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:10.277803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:10.301904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:10.303642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:10.362680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34a8b3d4b704c1da7c6b8dd74675440', 'request_id': 'req-f3296e36-bec5-4087-bf8c-3728f83ecf9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.373580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34a8b3d4b704c1da7c6b8dd74675440', 'request_id': 'req-f3296e36-bec5-4087-bf8c-3728f83ecf9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.409038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34a8b3d4b704c1da7c6b8dd74675440', 'request_id': 'req-f3296e36-bec5-4087-bf8c-3728f83ecf9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.415329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1104/2204] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:10.424749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:10.425151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] The token cache is being invalidate because project c34a8b3d4b704c1da7c6b8dd74675440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:10.425562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.426219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:10.426939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:10.429033 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1101/2205] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:10 2022] DELETE /identity/v3/projects/c34a8b3d4b704c1da7c6b8dd74675440 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:10.573530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e76e0-7889-4d7c-9928-2521a2c5ce3e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:10.703767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:10.704605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:10.704954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:10.705300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:10.707422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:10.816550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:10.818524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4e2f6-0151-4f25-ac49-749bd5fa25e0 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:10.842534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1105/2206] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:10.962550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:10.964775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.034927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.035512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.036126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.066872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296e36-bec5-4087-bf8c-3728f83ecf9c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:11.074162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:11.075092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.075382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.075829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.080357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.109760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] MFA Rules not processed for user `20c57f1318cd4c73b2248b2d02896176`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:11.111827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.184135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:11.186642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3daa-9141-4fe9-8edd-d4a434438e8f service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:11.205876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1102/2207] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:11.246876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1106/2208] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:11.258952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.259413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.259803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.299606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] MFA Rules not processed for user `20c57f1318cd4c73b2248b2d02896176`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:11.302317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.318598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1103/2209] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:11.337138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:11.337138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.395826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:11.397509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:11.419446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9867b-f13d-401b-ad12-9c64028170ab None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:11.424771 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:11.425780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.426080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.426363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] PATH_INFO: `/v3/projects/eaf722e91a2f4b96985e11dfd70b0965` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.428041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf722e91a2f4b96985e11dfd70b0965)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:11.430045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:11.440363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbdfc3-60ca-44bd-a837-fa8d76d00759 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:11.446033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:11.446684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.446965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.447237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.454917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:11.456709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:11.466332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1107/2210] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:11.478298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf722e91a2f4b96985e11dfd70b0965', 'request_id': 'req-41ce50e8-6199-4947-bf5f-bc05e38a58f8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.483478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf722e91a2f4b96985e11dfd70b0965', 'request_id': 'req-41ce50e8-6199-4947-bf5f-bc05e38a58f8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.493576 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf722e91a2f4b96985e11dfd70b0965', 'request_id': 'req-41ce50e8-6199-4947-bf5f-bc05e38a58f8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.504949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] The token cache is being invalidate because project eaf722e91a2f4b96985e11dfd70b0965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:11.505234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.505968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.507772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1104/2211] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:11 2022] DELETE /identity/v3/projects/eaf722e91a2f4b96985e11dfd70b0965 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:11.511890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:11.522859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c23e-9a6f-47d0-af45-0a8f8b85f282 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:11.578258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:11.579148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:11.579493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:11.579768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] PATH_INFO: `/v3/users/dc38f23d8bd64781a464d248d7e780fd` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:11.581023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc38f23d8bd64781a464d248d7e780fd)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:11.582995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:11.632406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc38f23d8bd64781a464d248d7e780fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.638611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc38f23d8bd64781a464d248d7e780fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.650427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc38f23d8bd64781a464d248d7e780fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.657495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc38f23d8bd64781a464d248d7e780fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.666045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4a22e05e-f08e-495a-ab69-6169516ec0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc38f23d8bd64781a464d248d7e780fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:11.672142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1108/2212] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:11 2022] DELETE /identity/v3/users/dc38f23d8bd64781a464d248d7e780fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:11.977233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:11.979255 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:12.000079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce50e8-6199-4947-bf5f-bc05e38a58f8 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.134270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.135842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.136132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.136409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] PATH_INFO: `/v3/projects/728eb22430334bcfb06a888898125cc5` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.140786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=728eb22430334bcfb06a888898125cc5)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.143528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.150372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501b9a-5e8e-44a4-8bec-a5a934c09371 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.150708 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501b9a-5e8e-44a4-8bec-a5a934c09371 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.150986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501b9a-5e8e-44a4-8bec-a5a934c09371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.169746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0d501b9a-5e8e-44a4-8bec-a5a934c09371 None None] MFA Rules not processed for user `20c57f1318cd4c73b2248b2d02896176`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:12.170971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0d501b9a-5e8e-44a4-8bec-a5a934c09371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:12.206191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728eb22430334bcfb06a888898125cc5', 'request_id': 'req-8b6661b8-d857-443e-a39c-d3db07ea8c5b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:12.212175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728eb22430334bcfb06a888898125cc5', 'request_id': 'req-8b6661b8-d857-443e-a39c-d3db07ea8c5b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:12.226717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728eb22430334bcfb06a888898125cc5', 'request_id': 'req-8b6661b8-d857-443e-a39c-d3db07ea8c5b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:12.238844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] The token cache is being invalidate because project 728eb22430334bcfb06a888898125cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:12.239335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:12.239781 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8b6661b8-d857-443e-a39c-d3db07ea8c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:12.242106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1105/2213] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:11 2022] DELETE /identity/v3/projects/728eb22430334bcfb06a888898125cc5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:12.246904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.247198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.247640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.252493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1109/2214] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:12.269153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:12.272402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:12.347658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1106/2215] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:12.355753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.356036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.356560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.393572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:12.398353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:12.428803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1110/2216] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:12.433131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.443555 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c4d1-6928-4519-9495-2b5e959ea232 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.449038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.449375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.449726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.450068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.450890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:12.451258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.453144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.469909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1107/2217] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:38:12.474335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.486265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d558d7-1a92-4363-9a44-ce7eb6732ae6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.492974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.493745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.494342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.494342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.495183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.497382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.541353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1111/2218] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:12.546445 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.558971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428144a-19dc-4f71-a4fd-441965aef203 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.629647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.630350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.630633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.630972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.631738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.635858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.662559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1108/2219] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:12.667011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.680981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa235c-72db-488a-abd8-5f99491bb91b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.687029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.687710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.689361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.690036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.691100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.693791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.708807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1112/2220] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:12.712897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.726667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942983a7-f8ec-420a-8772-0b477e0c11fa admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.734671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.735795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.736223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.736985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.738376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.740929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041cce7-3f60-4146-a158-78ad9df796f7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.757216 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1109/2221] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:38:12.761184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:12.777021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2948df-fefb-460a-900f-7e9705e2cc3d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:12.784125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:12.785406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.785830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.786178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] PATH_INFO: `/v3/projects/2bf1361310dc4d6faa5133c8fe21f416/users/ddae19d50bfd444ca640badb2413ce1a/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.804572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf1361310dc4d6faa5133c8fe21f416, user_id=ddae19d50bfd444ca640badb2413ce1a, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:12.807489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:12.824929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1113/2222] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:12 2022] PUT /identity/v3/projects/2bf1361310dc4d6faa5133c8fe21f416/users/ddae19d50bfd444ca640badb2413ce1a/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:12.835975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:12.836634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:12.837091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:12.873613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] MFA Rules not processed for user `ddae19d50bfd444ca640badb2413ce1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:12.875384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:12.952409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1110/2223] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:12.957424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.060192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16869-235f-4944-b622-d59e3a3abd1f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.067270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.067957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.068238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.069524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.070835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.072761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.113281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.113779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1114/2224] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:12 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:13.124319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830c4f-86c1-458c-a56a-24088687e34f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.208043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.208043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.208043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.208043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.209217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.212475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.256489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1111/2225] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:13 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:13.260368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.281435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0363-41cf-431b-b236-fc4f95dde633 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.288090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.288522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.288970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.289249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.289986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.291603 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.311723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1115/2226] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:13.312574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.338735 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23bbe9-7948-4006-88de-0a01b235b2d7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.346521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.347559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.348042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.348799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.352938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.356200 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd697e-776a-40ca-a62a-dae2070092db admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.386752 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.400822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1112/2227] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:13.402130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637992-c264-4881-b9f5-510fff33c79c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.443787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.446286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.449714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.450323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] PATH_INFO: `/v3/projects/eda151fb7e8a44998ca47e8dfb4c4fa9/users/938db28a1f1240d5b58a558d2a39d459/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.495731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda151fb7e8a44998ca47e8dfb4c4fa9, user_id=938db28a1f1240d5b58a558d2a39d459, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.498534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.532744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1116/2228] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:13 2022] PUT /identity/v3/projects/eda151fb7e8a44998ca47e8dfb4c4fa9/users/938db28a1f1240d5b58a558d2a39d459/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:13.550553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.550889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.551283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.595470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] MFA Rules not processed for user `938db28a1f1240d5b58a558d2a39d459`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:13.597511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:13.732263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1113/2229] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:13.736586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.853006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca472-2239-4e4a-b7f3-50ca16aadf41 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:13.860952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:13.862133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:13.862688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:13.863189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:13.864210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:13.866699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:13.937836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1117/2230] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:13 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:13.941613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:13.966549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067f006-0e9c-492b-96bf-5bd2dfd4bc1e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.161481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.162636 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.163054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.163325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.164034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.167124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.197600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1114/2231] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:13 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:14.203712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:14.217494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddf991-440c-4029-98e0-0fc4c907721e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.223494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.224173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.224528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.225177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.225509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.227126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.251538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1118/2232] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:14.253595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:14.265534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50483cfa-560c-4acc-a20e-ae86feb35e5a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.271762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.273003 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.273117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.273521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] PATH_INFO: `/v3/projects/f683cb8c703a4ef3b05bde0a31c625db/users/e14137c053154e8a8b6d369e45d9c478/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.293162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f683cb8c703a4ef3b05bde0a31c625db, user_id=e14137c053154e8a8b6d369e45d9c478, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.296095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.312974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1115/2233] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:14 2022] PUT /identity/v3/projects/f683cb8c703a4ef3b05bde0a31c625db/users/e14137c053154e8a8b6d369e45d9c478/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:14.317862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:14.338793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67796d-1258-489c-a1b5-600dcffcc8e3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.422322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.423489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.423489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.423676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.424476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.426761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d8cf0-02bc-4622-a07a-9d7698440a22 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.445891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1119/2234] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:14.451789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:14.483099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8e6-1e76-4dd9-967a-cf4d63009755 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.496267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.497346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.497659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.497938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] PATH_INFO: `/v3/projects/f683cb8c703a4ef3b05bde0a31c625db/users/e14137c053154e8a8b6d369e45d9c478/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.502479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f683cb8c703a4ef3b05bde0a31c625db, user_id=e14137c053154e8a8b6d369e45d9c478, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.507324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.537012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1116/2235] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:14 2022] PUT /identity/v3/projects/f683cb8c703a4ef3b05bde0a31c625db/users/e14137c053154e8a8b6d369e45d9c478/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:14.539745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.540194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.540372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.580007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] MFA Rules not processed for user `e14137c053154e8a8b6d369e45d9c478`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:14.581532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:14.709314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1120/2236] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:14.722836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:14.725574 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:14.859486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b2ca-f7ac-4313-bd2f-73794ac9bd98 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:14.868632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:14.869315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:14.869599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:14.869878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:14.926592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:14.928883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:14.954599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1117/2237] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:15.907705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:15.921687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161699d-9d13-4660-b38d-1442b22cfca5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:15.936137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:15.937222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:15.937747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:15.938202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:16.107212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:16.108889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ae698-8fb6-4086-9fac-6dbdd22b8b0b service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:16.131834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1121/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:17.177123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:17.179731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:17.289732 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb91a8d-66a9-4a4f-82ef-557d8a17f524 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:17.298396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:17.305523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:17.305905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:17.306185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] PATH_INFO: `/v3/users/f8cb6ae1c05a4be0bf4b6a09c6edd55e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:17.307600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cb6ae1c05a4be0bf4b6a09c6edd55e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:17.310076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:17.378650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cb6ae1c05a4be0bf4b6a09c6edd55e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:17.392949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cb6ae1c05a4be0bf4b6a09c6edd55e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:17.399754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cb6ae1c05a4be0bf4b6a09c6edd55e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:17.400635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cb6ae1c05a4be0bf4b6a09c6edd55e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:17.410096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cb6ae1c05a4be0bf4b6a09c6edd55e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:17.416398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1118/2239] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:17 2022] DELETE /identity/v3/users/f8cb6ae1c05a4be0bf4b6a09c6edd55e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:17.422261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:17.422654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:17.422824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:17.446505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:17.447947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:17.525318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1122/2240] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:17.535166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:17.536579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:17.599468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483931a-2261-4769-b7c4-2a8ba210717d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:17.603480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:17.604135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:17.604418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:17.604721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:17.615694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:17.618140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:17.633981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1119/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:17.915888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:17.917457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:17.930729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75886d30-7e4e-4ca1-a81a-491a1a23edfa None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:17.937971 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:17.939688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:17.940206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:17.940865 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] PATH_INFO: `/v3/projects/799e3b06011e4d36ad0c020e3a261a9f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:17.945745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=799e3b06011e4d36ad0c020e3a261a9f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:17.949557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:18.013769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799e3b06011e4d36ad0c020e3a261a9f', 'request_id': 'req-7ec020e9-b900-433e-b896-ad4dd4242d6d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.030637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799e3b06011e4d36ad0c020e3a261a9f', 'request_id': 'req-7ec020e9-b900-433e-b896-ad4dd4242d6d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.038602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799e3b06011e4d36ad0c020e3a261a9f', 'request_id': 'req-7ec020e9-b900-433e-b896-ad4dd4242d6d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.049953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] The token cache is being invalidate because project 799e3b06011e4d36ad0c020e3a261a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:18.050232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.050876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.052832 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1123/2242] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:17 2022] DELETE /identity/v3/projects/799e3b06011e4d36ad0c020e3a261a9f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:18.056830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:18.066539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c66c-d647-4c06-952d-d45f1bad620d service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:18.121715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:18.122573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:18.122860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:18.123143 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] PATH_INFO: `/v3/users/232ed51a32144303bbef0ad29d7c2d11` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:18.124319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] RBAC: Authorizing `identity:delete_user(user_id=232ed51a32144303bbef0ad29d7c2d11)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:18.126277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:18.184166 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232ed51a32144303bbef0ad29d7c2d11'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.197889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232ed51a32144303bbef0ad29d7c2d11'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.204934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232ed51a32144303bbef0ad29d7c2d11'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.205684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232ed51a32144303bbef0ad29d7c2d11'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.214265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232ed51a32144303bbef0ad29d7c2d11'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.220147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1120/2243] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:18 2022] DELETE /identity/v3/users/232ed51a32144303bbef0ad29d7c2d11 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:18.519527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:18.521196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:18.537553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec020e9-b900-433e-b896-ad4dd4242d6d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:18.600459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:18.601328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:18.601616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:18.601907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] PATH_INFO: `/v3/projects/53fa73af1c3146e2ad08eb3d93445b82` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:18.603339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fa73af1c3146e2ad08eb3d93445b82)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:18.605316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:18.657475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fa73af1c3146e2ad08eb3d93445b82', 'request_id': 'req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.664653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fa73af1c3146e2ad08eb3d93445b82', 'request_id': 'req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.673940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fa73af1c3146e2ad08eb3d93445b82', 'request_id': 'req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.686885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] The token cache is being invalidate because project 53fa73af1c3146e2ad08eb3d93445b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:18.687169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.687911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.689672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1124/2244] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:18 2022] DELETE /identity/v3/projects/53fa73af1c3146e2ad08eb3d93445b82 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:18.693816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:18.695305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:18.708899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05755-2bc9-4fdf-b461-e48b9378425c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:18.764802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:18.765679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:18.765963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:18.766230 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] PATH_INFO: `/v3/users/30aafabedef34a2b9062256e9311e761` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:18.767425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30aafabedef34a2b9062256e9311e761)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:18.769384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:18.821441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30aafabedef34a2b9062256e9311e761'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.834641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30aafabedef34a2b9062256e9311e761'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.841675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30aafabedef34a2b9062256e9311e761'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.842338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30aafabedef34a2b9062256e9311e761'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.852061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-16b774cb-63fc-4908-a6fd-275dd51b150a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30aafabedef34a2b9062256e9311e761'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:18.858571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1121/2245] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:18 2022] DELETE /identity/v3/users/30aafabedef34a2b9062256e9311e761 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:19.139985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.141568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:19.154140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82ee7-fd97-4779-a49c-4f7fd28dc18a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.229091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.229975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.230257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.230533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] PATH_INFO: `/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.231884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d7f91dcbe34a97a42515e84680dcd9)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.234018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.288564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d7f91dcbe34a97a42515e84680dcd9', 'request_id': 'req-76b67762-315d-4e75-8445-015f2280546c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:19.293726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d7f91dcbe34a97a42515e84680dcd9', 'request_id': 'req-76b67762-315d-4e75-8445-015f2280546c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:19.302002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d7f91dcbe34a97a42515e84680dcd9', 'request_id': 'req-76b67762-315d-4e75-8445-015f2280546c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:19.313274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] The token cache is being invalidate because project e2d7f91dcbe34a97a42515e84680dcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:19.313558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:19.314201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-76b67762-315d-4e75-8445-015f2280546c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:19.315824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1125/2246] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:19 2022] DELETE /identity/v3/projects/e2d7f91dcbe34a97a42515e84680dcd9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:19.321208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.322109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.322400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.340473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:19.341692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:19.399353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1122/2247] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:19.407502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.407816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.408094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.427784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:19.429011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:19.437468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1126/2248] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:19.442015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.452142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e794cb-39dc-42c1-b88c-608dbe71ed38 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.458036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.458683 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.458985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.459265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.459982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:19.460310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.461939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.474577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1123/2249] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:19.479126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.489135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03459dd-4fc2-425d-9df2-e6f95798045c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.495085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.495747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.496029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.496302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.497039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.498975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.530640 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1127/2250] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:19.535055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.546185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb007db-af45-4508-9821-e2b3b39fe6a4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.619880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.620653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.620940 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.621221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.621961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.624010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.646267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1124/2251] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:19 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:19.650321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.662229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058baca-7751-4120-8131-c57f990af2fd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.672717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.673409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.673694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.673973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.674718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.676485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.691024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1128/2252] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:19.695859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.710536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a819d-d25c-4502-af50-c15328c3b752 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.716175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.716981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.717360 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.717671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.718569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.721318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b1236-067a-46b9-8559-d16b8ff2c178 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.732569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1125/2253] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:38:19.736955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.747039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62174f-c0a8-4386-a04d-351bcf0d5d0a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.752076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.752975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.753255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.753527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] PATH_INFO: `/v3/projects/4e621ff2341f45e586ea95a515d8d79e/users/651e2e25f3b9492a8f946579974b52ff/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.768776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e621ff2341f45e586ea95a515d8d79e, user_id=651e2e25f3b9492a8f946579974b52ff, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:19.771484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:19.785851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1129/2254] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:19 2022] PUT /identity/v3/projects/4e621ff2341f45e586ea95a515d8d79e/users/651e2e25f3b9492a8f946579974b52ff/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:19.797146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.797437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.797713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:19.825595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] MFA Rules not processed for user `651e2e25f3b9492a8f946579974b52ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:19.827157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:19.899230 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1126/2255] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:19.913735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:19.916219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:19.992240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05796280-8c24-488e-8a0b-45c598b713fd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:19.996842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:19.997483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:19.997760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:19.998026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:20.006839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:20.008268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:20.017194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1130/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:22.691078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:22.809596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b196a-c24e-4c1e-a0c2-0913ecc80029 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:22.812634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:22.815395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:22.820857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:22.822504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:22.823514 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:22.823755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] PATH_INFO: `/v3/users/651e2e25f3b9492a8f946579974b52ff` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:22.825145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=651e2e25f3b9492a8f946579974b52ff)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:22.827432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:22.834787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5d9c-2dc3-4c55-a5bd-e5e3387eaf0f service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:22.844933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:22.846272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:22.847326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:22.849914 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:22.856002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:22.918912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651e2e25f3b9492a8f946579974b52ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:22.939657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651e2e25f3b9492a8f946579974b52ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:22.941655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:22.943159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a4778-0fe2-49a7-9197-daca9b81f9bc service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:22.947393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651e2e25f3b9492a8f946579974b52ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:22.948159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651e2e25f3b9492a8f946579974b52ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:22.954624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1131/2257] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:22.955718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651e2e25f3b9492a8f946579974b52ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:22.961847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1127/2258] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:22 2022] DELETE /identity/v3/users/651e2e25f3b9492a8f946579974b52ff => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:22.967558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:22.967853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:22.968135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:22.985717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:22.986938 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:23.045296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1132/2259] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:23.061191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.062731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:23.124137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97f3c-bac3-4b9f-90bf-d580469a0ace admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.129152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.129831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.130073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.130354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.139790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.141277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc08c9-3084-4f6b-ab8f-59a9ab308178 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.151642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1128/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:23.434822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.436615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:23.449472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54d25-8f71-414f-8302-6f6671b39c55 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.458824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.460050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.460333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.460686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] PATH_INFO: `/v3/projects/4e621ff2341f45e586ea95a515d8d79e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.461848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e621ff2341f45e586ea95a515d8d79e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.463985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.511845 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e621ff2341f45e586ea95a515d8d79e', 'request_id': 'req-0fca72a9-00a7-4e04-b0bc-441e29e2058b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:23.521388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e621ff2341f45e586ea95a515d8d79e', 'request_id': 'req-0fca72a9-00a7-4e04-b0bc-441e29e2058b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:23.530396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e621ff2341f45e586ea95a515d8d79e', 'request_id': 'req-0fca72a9-00a7-4e04-b0bc-441e29e2058b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:23.542019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] The token cache is being invalidate because project 4e621ff2341f45e586ea95a515d8d79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:23.542296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:23.542915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0fca72a9-00a7-4e04-b0bc-441e29e2058b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:23.544848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1133/2261] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:23 2022] DELETE /identity/v3/projects/4e621ff2341f45e586ea95a515d8d79e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:23.550034 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.550325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.550605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.568871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:23.570103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:23.628419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1129/2262] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:23.636341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.636773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.637260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.658216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:23.659425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:23.668000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1134/2263] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:23.672851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.683220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64b23a-1b70-4acd-96a1-b6867421433d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.688234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.689006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.689292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.689568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.690332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:23.690605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.693390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.704727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1130/2264] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:23.709148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.718975 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323cf28-b728-4266-adc5-89fbd55c8001 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.723642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.724363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.724670 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.724973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.725674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.727578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.755703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1135/2265] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:23 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:23.759836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.770229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd44b0-f0cc-4cd5-8949-c1d35f1bde25 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.827908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.828623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.828959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.829243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.829950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.832060 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.851509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1131/2266] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:23 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:23.855908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.867215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea1c4-cf1c-468a-bad4-e91c72550a05 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.873256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.873930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.874224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.874508 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.875214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.876884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.888226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1136/2267] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:23.892563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.904007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c256f-0b27-4a8e-82ce-464597fef243 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.909349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.910097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.910410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.910712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.911449 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.913090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec344196-9f36-49ea-ba4a-34ed21a128e3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.923813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1132/2268] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:23.928662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:23.941828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a625c95-54a6-4985-8b59-dfcaf98ed184 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:23.945483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:23.946417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.946694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.946970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] PATH_INFO: `/v3/projects/0e3b03bccfc14da7868d54ec534f41c3/users/e0afae43544d49ca868f09df0817990c/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:23.962304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3b03bccfc14da7868d54ec534f41c3, user_id=e0afae43544d49ca868f09df0817990c, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:23.965121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:23.980013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1137/2269] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:23 2022] PUT /identity/v3/projects/0e3b03bccfc14da7868d54ec534f41c3/users/e0afae43544d49ca868f09df0817990c/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:23.991150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:23.991676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:23.992163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:24.026626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] MFA Rules not processed for user `e0afae43544d49ca868f09df0817990c`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:24.028597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:24.103373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1133/2270] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:24.115243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:24.117654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:24.184400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a14f-f7a3-4905-9a2b-d1b57a88b1b1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:24.188127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:24.188796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:24.189078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:24.189351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:24.198557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:24.200033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:24.209820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1138/2271] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:25.116721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.118565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.221845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6903f0-f845-47d4-b389-c66ecdc8921b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.227590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.228825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.229115 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.229454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] PATH_INFO: `/v3/users/ddae19d50bfd444ca640badb2413ce1a` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.230770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddae19d50bfd444ca640badb2413ce1a)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.232939 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:25.300813 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddae19d50bfd444ca640badb2413ce1a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.305140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.305963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.320250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddae19d50bfd444ca640badb2413ce1a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.320456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c547d-bfa7-45e9-9487-4cc2354129d0 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.325520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddae19d50bfd444ca640badb2413ce1a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.325679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.326490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddae19d50bfd444ca640badb2413ce1a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.326600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.326842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.327117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] PATH_INFO: `/v3/users/84c59f7cd9dc478388802071ea4dcc2f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.328305 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c59f7cd9dc478388802071ea4dcc2f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.330281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:25.335673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-10dbe0fa-5e68-42ea-a552-752caae11b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddae19d50bfd444ca640badb2413ce1a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.347126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1134/2272] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:25 2022] DELETE /identity/v3/users/ddae19d50bfd444ca640badb2413ce1a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:25.350651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.350956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.351240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.370917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:25.372288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.385163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c59f7cd9dc478388802071ea4dcc2f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.385999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c59f7cd9dc478388802071ea4dcc2f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.398627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c59f7cd9dc478388802071ea4dcc2f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.405918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c59f7cd9dc478388802071ea4dcc2f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.415357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d445da38-2768-4541-922d-6d94755df7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c59f7cd9dc478388802071ea4dcc2f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:25.421649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1139/2273] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:25 2022] DELETE /identity/v3/users/84c59f7cd9dc478388802071ea4dcc2f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:25.425983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.426275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.426556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.432312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1135/2274] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:25.441984 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.443349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.444215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:25.445396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.497353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07661d29-def3-4d93-ba08-38b5be3ae32b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.500316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1140/2275] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:25.510143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.545209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.546029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.546342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.546612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.556488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.558056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:25.567697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1136/2276] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:25.578249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6adb41-cc50-44ee-bad8-2f43ac59642c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.582477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.583128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.583402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.583909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.593161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.594759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:25.605115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1141/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:25.918917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.920471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.946525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2f01-aa5b-407e-b5d8-c84b340a2c34 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.952365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.953598 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.953988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.954338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] PATH_INFO: `/v3/projects/2bf1361310dc4d6faa5133c8fe21f416` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.955938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf1361310dc4d6faa5133c8fe21f416)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.958370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:25.969510 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:25.971006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:25.984771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420470a-f01f-4e3a-a576-a23bf5fc5815 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:25.989231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:25.990654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:25.991238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:25.991702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] PATH_INFO: `/v3/projects/bf21a099d07c42639d4ce684a4f40ed8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:25.993361 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf21a099d07c42639d4ce684a4f40ed8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:25.995759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.018577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf1361310dc4d6faa5133c8fe21f416', 'request_id': 'req-ec582030-2096-4ccc-949b-452686664247'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.025221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf1361310dc4d6faa5133c8fe21f416', 'request_id': 'req-ec582030-2096-4ccc-949b-452686664247'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.033726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf1361310dc4d6faa5133c8fe21f416', 'request_id': 'req-ec582030-2096-4ccc-949b-452686664247'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.047551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf21a099d07c42639d4ce684a4f40ed8', 'request_id': 'req-638d08e6-fe48-4569-9749-b8c18508fcc1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.050031 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] The token cache is being invalidate because project 2bf1361310dc4d6faa5133c8fe21f416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:26.050331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.051041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.053356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf21a099d07c42639d4ce684a4f40ed8', 'request_id': 'req-638d08e6-fe48-4569-9749-b8c18508fcc1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.054030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1137/2278] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:25 2022] DELETE /identity/v3/projects/2bf1361310dc4d6faa5133c8fe21f416 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:26.058234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.060518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.063689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf21a099d07c42639d4ce684a4f40ed8', 'request_id': 'req-638d08e6-fe48-4569-9749-b8c18508fcc1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.075611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] The token cache is being invalidate because project bf21a099d07c42639d4ce684a4f40ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:26.076479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.077123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-638d08e6-fe48-4569-9749-b8c18508fcc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.079678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1142/2279] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:25 2022] DELETE /identity/v3/projects/bf21a099d07c42639d4ce684a4f40ed8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:26.086558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de867-8b06-43c6-b980-22be014e9dc3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.087272 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de867-8b06-43c6-b980-22be014e9dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.087558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de867-8b06-43c6-b980-22be014e9dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.107201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ec8de867-8b06-43c6-b980-22be014e9dc3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:26.108419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ec8de867-8b06-43c6-b980-22be014e9dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.130909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec582030-2096-4ccc-949b-452686664247 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.172573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1143/2280] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:26.181110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.181447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.181907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.197271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.198384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.198670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.198954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] PATH_INFO: `/v3/users/938db28a1f1240d5b58a558d2a39d459` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.200036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:26.200176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938db28a1f1240d5b58a558d2a39d459)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.201363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.202107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.210490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1144/2281] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:26.214682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.223861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b060f1-c388-4667-b94f-0d00dc2c640f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.229427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.230271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.230589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.230972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.231948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:26.232273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.234130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.247220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1145/2282] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:38:26.251633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.255577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938db28a1f1240d5b58a558d2a39d459'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.261969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e658-250b-44a9-97c7-502f9c83859b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.267598 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.268902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.269284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938db28a1f1240d5b58a558d2a39d459'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.269427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.269593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.270292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.272780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.281411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938db28a1f1240d5b58a558d2a39d459'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.282174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938db28a1f1240d5b58a558d2a39d459'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.290843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938db28a1f1240d5b58a558d2a39d459'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.297800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1138/2283] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:26 2022] DELETE /identity/v3/users/938db28a1f1240d5b58a558d2a39d459 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:26.329162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.338494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1146/2284] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:26 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:26.338973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.434679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9a97-bb2f-41e1-a352-8209e387d1b3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.497706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.498468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.498751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.499023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.499761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.502220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.527405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1139/2285] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:26 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:26.531477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.541923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0599-6b20-47ea-ac40-2fa86d46f70a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.548212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.548925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.549211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.549489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.552519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.554210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.564713 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1147/2286] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:26.568776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.579509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2b02-8d5d-4449-b8db-85ab79cacd9b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.584811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.585455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.585723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.586030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.586750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.588342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.604692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.606447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.606682 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1140/2287] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:26.607728 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.620646 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195aed-6f58-4aa6-ad30-8fb5e12d2873 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.626241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.627141 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.628107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.628753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] PATH_INFO: `/v3/projects/4eebbd7a278542fbbd3a886a2c5dc2d5/users/d61d8564f537409e8d81a1a0a8192e53/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.629768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6190-8de4-4aea-87f2-42862d283fa1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.638719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.639596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.639878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.640152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] PATH_INFO: `/v3/projects/eda151fb7e8a44998ca47e8dfb4c4fa9` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.641453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda151fb7e8a44998ca47e8dfb4c4fa9)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.643590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.652238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eebbd7a278542fbbd3a886a2c5dc2d5, user_id=d61d8564f537409e8d81a1a0a8192e53, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.654942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e177a7-b5df-4b64-a0f8-80e32060b3a5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.670553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1141/2288] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:26 2022] PUT /identity/v3/projects/4eebbd7a278542fbbd3a886a2c5dc2d5/users/d61d8564f537409e8d81a1a0a8192e53/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:26.681244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.681551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.681796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.698570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda151fb7e8a44998ca47e8dfb4c4fa9', 'request_id': 'req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.704162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda151fb7e8a44998ca47e8dfb4c4fa9', 'request_id': 'req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.707529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] MFA Rules not processed for user `d61d8564f537409e8d81a1a0a8192e53`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:26.708756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.711728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda151fb7e8a44998ca47e8dfb4c4fa9', 'request_id': 'req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.723333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] The token cache is being invalidate because project eda151fb7e8a44998ca47e8dfb4c4fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:26.723616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.724275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.725898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1148/2289] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:26 2022] DELETE /identity/v3/projects/eda151fb7e8a44998ca47e8dfb4c4fa9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:26.729687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.731027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.775061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1142/2290] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:26.787277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:26.790397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.800079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b457cef-f8ba-40a0-90dd-8f19ba35ae92 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.805097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.805977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.806251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.806522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] PATH_INFO: `/v3/users/e14137c053154e8a8b6d369e45d9c478` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.807731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14137c053154e8a8b6d369e45d9c478)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.809695 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.856987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f1644-1370-4ca0-9e86-a5ae696448f7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:26.858535 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14137c053154e8a8b6d369e45d9c478'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.859777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14137c053154e8a8b6d369e45d9c478'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.862871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:26.863458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:26.863795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:26.864077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:26.866220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:26.872253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14137c053154e8a8b6d369e45d9c478'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.879219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14137c053154e8a8b6d369e45d9c478'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.881128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:26.882613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:26.892987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-033878f2-a87b-4543-b132-43e493f8ec87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14137c053154e8a8b6d369e45d9c478'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:26.896284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1143/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:38:26.900203 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1149/2292] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:26 2022] DELETE /identity/v3/users/e14137c053154e8a8b6d369e45d9c478 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:27.244539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.246759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:27.268702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd51ef-591a-4bd7-9a49-3978411c0f4c service glance] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.343137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.344534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.345002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.345459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] PATH_INFO: `/v3/projects/f683cb8c703a4ef3b05bde0a31c625db` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.347548 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f683cb8c703a4ef3b05bde0a31c625db)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.350697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.417717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f683cb8c703a4ef3b05bde0a31c625db', 'request_id': 'req-57f70dae-39e2-4be1-bf98-3eb7300060c1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:27.423170 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f683cb8c703a4ef3b05bde0a31c625db', 'request_id': 'req-57f70dae-39e2-4be1-bf98-3eb7300060c1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:27.432058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f683cb8c703a4ef3b05bde0a31c625db', 'request_id': 'req-57f70dae-39e2-4be1-bf98-3eb7300060c1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:27.443097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] The token cache is being invalidate because project f683cb8c703a4ef3b05bde0a31c625db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:27.443384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:27.444006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-57f70dae-39e2-4be1-bf98-3eb7300060c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:27.445594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1144/2293] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:27 2022] DELETE /identity/v3/projects/f683cb8c703a4ef3b05bde0a31c625db => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:27.451559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.452041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.452135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.470058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:27.471269 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:27.547304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1150/2294] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:27.556321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.556624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.556894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.575140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:27.576240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:27.584637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1145/2295] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:27.589013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.599060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f241f85-4b75-466b-a9b3-1269b35c2af0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.603797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.604492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.604778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.605052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.605789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:27.606117 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.607718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.620160 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1151/2296] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:27.624595 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.634098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfd9bb-5270-46fb-a4be-a779066031a3 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.639506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.640183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.640501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.640886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.641589 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.643621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.673344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1146/2297] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:27 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:27.674539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.686806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970baf5-c33b-46fa-99c7-3fda67fd3033 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.744443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.745143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.745438 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.745702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.746392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.748315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.772704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1152/2298] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:27 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:27.777306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.788549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169af3a-4e56-424b-9677-74e0914f14eb admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.793490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.794496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.794903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.795179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.795927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.797535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.808927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1147/2299] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:27.812917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.822881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835b2f-8363-4fda-9afd-80b7065e042e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.828556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.829154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.829443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.829711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.830446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.832089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844b16-9d41-42b3-8022-ab3715c21812 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.842218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1153/2300] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:27.846519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:27.856725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439b57-eb4a-4784-a125-f3a8996769e2 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:27.861550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:27.862428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.862704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.862974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] PATH_INFO: `/v3/projects/e32405fa9750430fba74cbdf94147e0d/users/976483e8145749e9960f01e933dc0ceb/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.877827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32405fa9750430fba74cbdf94147e0d, user_id=976483e8145749e9960f01e933dc0ceb, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:27.880633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:27.894040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1148/2301] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:27 2022] PUT /identity/v3/projects/e32405fa9750430fba74cbdf94147e0d/users/976483e8145749e9960f01e933dc0ceb/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:27.905163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:27.905595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:27.905934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:27.934501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] MFA Rules not processed for user `976483e8145749e9960f01e933dc0ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:27.935706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:28.001636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1154/2302] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:28.006376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.066283 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44917-bc42-4517-964c-1d8a0de48659 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.071303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.071953 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.072214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.072507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.073218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.075113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.101475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1149/2303] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:28 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:28.105484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.116481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcf21-d160-44ee-9e71-43d39516ade9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.172453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.173158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.173436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.173736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.174467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.176478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.198371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1155/2304] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:28 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:28.202751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.213540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cafc7-3170-4989-8462-7fc7b2ef4e98 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.218710 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.219376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.219699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.219970 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.220743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.222355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.233865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1150/2305] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:28.238673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.249398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be345-8460-4ca8-b6cb-efafe65a8625 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.254365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.255263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.255549 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.255827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] PATH_INFO: `/v3/projects/c599d170d2634b2789233b362b3ad6d1/users/dd2985a401fd41ef9205031faa4aa8ed/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.271342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c599d170d2634b2789233b362b3ad6d1, user_id=dd2985a401fd41ef9205031faa4aa8ed, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.274048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.289892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1156/2306] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:28 2022] PUT /identity/v3/projects/c599d170d2634b2789233b362b3ad6d1/users/dd2985a401fd41ef9205031faa4aa8ed/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:28.294040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.305134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09929945-5d99-44fa-8c18-2f0f31c53db3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.362461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.363076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.363412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.363656 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.364404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.366027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afa40d-f430-4a6f-a9be-493897309dfb admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.375671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1151/2307] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:28.379995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.390513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442b3a-e741-4f98-b88e-fde42c999345 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.395927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.396856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.397154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.397433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] PATH_INFO: `/v3/projects/c599d170d2634b2789233b362b3ad6d1/users/dd2985a401fd41ef9205031faa4aa8ed/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.400830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c599d170d2634b2789233b362b3ad6d1, user_id=dd2985a401fd41ef9205031faa4aa8ed, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.403478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.414921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1157/2308] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:28 2022] PUT /identity/v3/projects/c599d170d2634b2789233b362b3ad6d1/users/dd2985a401fd41ef9205031faa4aa8ed/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:28.425848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.426219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.426408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.455485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] MFA Rules not processed for user `dd2985a401fd41ef9205031faa4aa8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:28.456731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:28.525243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1152/2309] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:28.537422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.539552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:28.602919 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba7fc-28da-4d25-964e-9831f91ee98e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.606827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.607486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.607773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.608036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.620881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.622644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.634948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1158/2310] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:28.723444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:28.734638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb596-d52b-413e-a186-445f22620444 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:28.739376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:28.740504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:28.740690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:28.740974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:28.805203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:28.806722 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af07fe-47de-40c4-93a7-cb19546c7eee service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:28.817021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1153/2311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:29.133738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:29.207614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d927-b96f-488e-96be-8edf9df97e66 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:29.213370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:29.214265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:29.214544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:29.214817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] PATH_INFO: `/v3/users/976483e8145749e9960f01e933dc0ceb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:29.216563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976483e8145749e9960f01e933dc0ceb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:29.218082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:29.284929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976483e8145749e9960f01e933dc0ceb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.285634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976483e8145749e9960f01e933dc0ceb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.297965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976483e8145749e9960f01e933dc0ceb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.305387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976483e8145749e9960f01e933dc0ceb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.313611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976483e8145749e9960f01e933dc0ceb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.319638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1159/2312] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:29 2022] DELETE /identity/v3/users/976483e8145749e9960f01e933dc0ceb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:29.324236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:29.324769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:29.324961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:29.343373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:29.344647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:29.404057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1154/2313] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:29.414108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:29.415642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:29.482283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003080f-82c3-4e84-b881-012418f095c8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:29.494098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:29.494766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:29.495052 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:29.495353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:29.505248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:29.506720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:29.516126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1160/2314] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:29.791244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:29.792878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:29.805380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88185b34-60d0-4bcd-8b87-d1665d0cce0e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:29.812982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:29.815441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:29.815897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:29.816179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] PATH_INFO: `/v3/projects/e32405fa9750430fba74cbdf94147e0d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:29.817471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32405fa9750430fba74cbdf94147e0d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:29.821343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:29.869776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32405fa9750430fba74cbdf94147e0d', 'request_id': 'req-61ae3eb7-7562-4b1d-8832-d0a2be005760'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.875830 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32405fa9750430fba74cbdf94147e0d', 'request_id': 'req-61ae3eb7-7562-4b1d-8832-d0a2be005760'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.884694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32405fa9750430fba74cbdf94147e0d', 'request_id': 'req-61ae3eb7-7562-4b1d-8832-d0a2be005760'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.896073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] The token cache is being invalidate because project e32405fa9750430fba74cbdf94147e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:29.896365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.897062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:29.898605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1155/2315] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:29 2022] DELETE /identity/v3/projects/e32405fa9750430fba74cbdf94147e0d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:29.902620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:29.912828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c1c5-564e-47f2-8765-e808ad5bce9b service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:29.976600 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:29.977506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:29.977789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:29.978061 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] PATH_INFO: `/v3/users/dd2985a401fd41ef9205031faa4aa8ed` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:29.979289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2985a401fd41ef9205031faa4aa8ed)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:29.981261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:30.030263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2985a401fd41ef9205031faa4aa8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.030947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2985a401fd41ef9205031faa4aa8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.045804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2985a401fd41ef9205031faa4aa8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.054413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2985a401fd41ef9205031faa4aa8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.065070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-947027a8-413a-49f6-bbb3-fb48b3f5ac5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2985a401fd41ef9205031faa4aa8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.072119 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1161/2316] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:29 2022] DELETE /identity/v3/users/dd2985a401fd41ef9205031faa4aa8ed => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:30.545904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:30.547370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:30.562573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3eb7-7562-4b1d-8832-d0a2be005760 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:30.616935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:30.617809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:30.618087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:30.618354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] PATH_INFO: `/v3/projects/c599d170d2634b2789233b362b3ad6d1` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:30.619536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c599d170d2634b2789233b362b3ad6d1)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:30.621489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:30.667229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c599d170d2634b2789233b362b3ad6d1', 'request_id': 'req-df00493b-ea41-462a-8968-962e89a0e8b2'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.672967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c599d170d2634b2789233b362b3ad6d1', 'request_id': 'req-df00493b-ea41-462a-8968-962e89a0e8b2'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.681593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c599d170d2634b2789233b362b3ad6d1', 'request_id': 'req-df00493b-ea41-462a-8968-962e89a0e8b2'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.692315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] The token cache is being invalidate because project c599d170d2634b2789233b362b3ad6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:30.692638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.693303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-df00493b-ea41-462a-8968-962e89a0e8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:30.694904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1156/2317] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:30 2022] DELETE /identity/v3/projects/c599d170d2634b2789233b362b3ad6d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:30.699786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:30.700079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:30.700357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:30.719012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:30.720202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:30.784903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1162/2318] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:30.795322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:30.795617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:30.795896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:30.816484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:30.817686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:30.827671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1157/2319] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:30.834763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:30.849433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f591a26-4ed1-4d50-87aa-e32ae29923c5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:30.855504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:30.856165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:30.856467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:30.856760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:30.857496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:30.857806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:30.859622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:30.871725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1163/2320] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:30.876275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:30.885942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9bfba-0af9-48a3-bcda-075c112f1f3e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:30.891973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:30.892681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:30.892963 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:30.893236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:30.893921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:30.896007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:30.928969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1158/2321] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:30 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:30.935394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:30.947731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20196-7932-418c-8732-90633d459b3d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:31.006869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:31.007540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.007827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.008101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.008824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:31.011776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:31.035926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1164/2322] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:30 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:31.040076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:31.050604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340665-6ba2-4068-8a00-a8f830c1745a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:31.056573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:31.057232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.057508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.057774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.058485 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:31.060062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:31.071015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1159/2323] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:31.075100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:31.086347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988acbe6-fda8-4e6c-b485-0cd32d2442c5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:31.091113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:31.091778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.092063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.092339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.093108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:31.094728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7e17-190e-4746-88a9-87db8c057685 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:31.104799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1165/2324] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:31.109155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:31.118954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487724-be29-4e2f-b08b-7f31091a41c0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:31.124207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:31.125163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.125441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.125715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] PATH_INFO: `/v3/projects/40fb0e2f399f4a64a790b19a89f1ab45/users/423213e7e5b54442b6ca83915d3610f8/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.140146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb0e2f399f4a64a790b19a89f1ab45, user_id=423213e7e5b54442b6ca83915d3610f8, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:31.142838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:31.157983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1160/2325] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:31 2022] PUT /identity/v3/projects/40fb0e2f399f4a64a790b19a89f1ab45/users/423213e7e5b54442b6ca83915d3610f8/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:31.168583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.168877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.169156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.195741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] MFA Rules not processed for user `423213e7e5b54442b6ca83915d3610f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:31.196988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:31.266553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1166/2326] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:31.278032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:31.279775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:31.341186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43244c9-8911-459d-a320-0c4affe9a71e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:31.345176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:31.345827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:31.346113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:31.346386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:31.355009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:31.356457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d10a8-0b1d-417c-a2c3-afbb5852a722 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:31.365463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1161/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:41.768797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:41.833829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdee4-321d-438f-823e-aa439cf04f57 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:41.838792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:41.839710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:41.839988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:41.840258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] PATH_INFO: `/v3/users/423213e7e5b54442b6ca83915d3610f8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:41.841483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423213e7e5b54442b6ca83915d3610f8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:41.843434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:41.892251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423213e7e5b54442b6ca83915d3610f8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.893033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423213e7e5b54442b6ca83915d3610f8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.905309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423213e7e5b54442b6ca83915d3610f8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.912009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423213e7e5b54442b6ca83915d3610f8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.921482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423213e7e5b54442b6ca83915d3610f8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.929336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1167/2328] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:41 2022] DELETE /identity/v3/users/423213e7e5b54442b6ca83915d3610f8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:41.934344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:41.934886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:41.935237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:41.959241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:41.960512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:42.023025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1162/2329] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:42.029785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.031044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:42.110799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5c1d-d08e-4491-9655-0f17fcbeacc5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.115224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.115905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.116186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.116497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.126820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.128289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d56bf2-8f2f-4a17-986e-068f49697417 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.139557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1168/2330] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:42.448901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.450490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:42.463311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffab32-331c-42b5-82d6-0ab744122760 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.480619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.480619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.480619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.480619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] PATH_INFO: `/v3/projects/40fb0e2f399f4a64a790b19a89f1ab45` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.481224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fb0e2f399f4a64a790b19a89f1ab45)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.486516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.557421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fb0e2f399f4a64a790b19a89f1ab45', 'request_id': 'req-caa7f025-2d61-42df-8a28-bb09a70ace46'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:42.564567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fb0e2f399f4a64a790b19a89f1ab45', 'request_id': 'req-caa7f025-2d61-42df-8a28-bb09a70ace46'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:42.572135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fb0e2f399f4a64a790b19a89f1ab45', 'request_id': 'req-caa7f025-2d61-42df-8a28-bb09a70ace46'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:42.584403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] The token cache is being invalidate because project 40fb0e2f399f4a64a790b19a89f1ab45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:42.584784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:42.585478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-caa7f025-2d61-42df-8a28-bb09a70ace46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:42.587454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1163/2331] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:42 2022] DELETE /identity/v3/projects/40fb0e2f399f4a64a790b19a89f1ab45 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:42.592827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.593116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.593394 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.612386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:42.613622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:42.681386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1169/2332] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:42.688972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.689426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.689764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.708607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:42.709893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:42.719006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1164/2333] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:42.723451 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.733990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fce81-a26e-45ad-b909-11e189ae1db5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.739057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.739781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.740060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.740331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.741204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:42.741717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.744100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.758341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1170/2334] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:38:42.762666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.773926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00f96f-6d3e-4145-b92f-c9eafbef6bf1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.779027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.779734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.780032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.780308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.781168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.783662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.841633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1165/2335] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:42 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:42.846021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.856429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678f6-d16b-4848-a1de-32f0dcdf32a8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.918434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.919118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.919399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.919666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.920372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.922318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.942685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1171/2336] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:42 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:38:42.946983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.957420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5849-dc18-4b3d-8ba8-bbad22b5c580 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.961962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.962616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.962894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.963164 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.963887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.965517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:42.975568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1166/2337] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:42.979812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:42.989852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6b50-c10b-4ba0-9a3d-9301f36be18c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:42.994863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:42.995516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:42.995801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:42.996066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:42.996819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:42.998453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141eb4-ac14-47e5-9c42-23a176819b51 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:43.008637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1172/2338] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:43.012817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:43.028223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da50aa-c5e0-4152-8081-2c380f11a69d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:43.033407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:43.034288 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:43.034565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:43.034850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] PATH_INFO: `/v3/projects/ce2d9351f88241bfa8406d6b6e3ec82f/users/61a9696a518b4d43a9f2129f6154d5fd/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:43.050430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2d9351f88241bfa8406d6b6e3ec82f, user_id=61a9696a518b4d43a9f2129f6154d5fd, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:43.053495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:43.069611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1167/2339] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:43 2022] PUT /identity/v3/projects/ce2d9351f88241bfa8406d6b6e3ec82f/users/61a9696a518b4d43a9f2129f6154d5fd/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:43.085286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:43.085556 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:43.085931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:43.117597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] MFA Rules not processed for user `61a9696a518b4d43a9f2129f6154d5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:43.121341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:43.189560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1173/2340] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:43.200755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:43.202466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:43.267198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c713-f203-4e11-8b4f-475afe3ae8ac admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:43.271658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:43.272310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:43.272630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:43.272884 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:43.282324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:43.283755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c60aec-0e8e-4d41-b21d-eda7e3f43068 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:43.293133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1168/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:48.875398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:48.877429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:48.943253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eca9c7-adfe-445f-a452-14e62f9aeaa8 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:48.948478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:48.949359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:48.949641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:48.949915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] PATH_INFO: `/v3/users/e0afae43544d49ca868f09df0817990c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:48.951142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0afae43544d49ca868f09df0817990c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:48.953440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:49.000625 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0afae43544d49ca868f09df0817990c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.001349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0afae43544d49ca868f09df0817990c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.013029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0afae43544d49ca868f09df0817990c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.019427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0afae43544d49ca868f09df0817990c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.027112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6b3a151a-fb81-4797-92f9-b71c229e65aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0afae43544d49ca868f09df0817990c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.033949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1174/2342] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:48 2022] DELETE /identity/v3/users/e0afae43544d49ca868f09df0817990c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:49.038270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:49.038861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:49.038950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:49.057383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:49.058945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:49.117786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:49.118092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:49.118360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:49.125509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1169/2343] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:38:49.135448 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:49.136894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] MFA Rules not processed for user `b578680e88c741bda2c8e56b2dc9d335`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:49.137058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:49.138001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:49.194096 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a56d8-d481-43b0-8f4a-aaed3484ea30 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:49.195309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1175/2344] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:49.199148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:49.199840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:49.200124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:49.200418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:49.210058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:49.211650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:49.223029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1170/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:49.510653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:49.512142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:49.535652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac09ed5-2aee-4ce6-a24c-75cda3c34089 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:49.543581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:49.564143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:49.564491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:49.564776 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] PATH_INFO: `/v3/projects/0e3b03bccfc14da7868d54ec534f41c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:49.570745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3b03bccfc14da7868d54ec534f41c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:49.579253 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:49.636849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3b03bccfc14da7868d54ec534f41c3', 'request_id': 'req-c122ac08-e223-48e3-bc7c-0f1c413c10f2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.643267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3b03bccfc14da7868d54ec534f41c3', 'request_id': 'req-c122ac08-e223-48e3-bc7c-0f1c413c10f2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.654610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3b03bccfc14da7868d54ec534f41c3', 'request_id': 'req-c122ac08-e223-48e3-bc7c-0f1c413c10f2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.667917 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] The token cache is being invalidate because project 0e3b03bccfc14da7868d54ec534f41c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:49.668325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.669112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c122ac08-e223-48e3-bc7c-0f1c413c10f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:49.670762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1176/2346] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:49 2022] DELETE /identity/v3/projects/0e3b03bccfc14da7868d54ec534f41c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:51.752188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:51.754421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:51.769734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd62f-3c7c-47e4-9f52-621a215b5cb5 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:51.835641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:51.837010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:51.837300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:51.837571 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] PATH_INFO: `/v3/users/eab35a4e11694744a86ae0b0e2fad907` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:51.838825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab35a4e11694744a86ae0b0e2fad907)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:51.840996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:51.898108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab35a4e11694744a86ae0b0e2fad907'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:51.910742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab35a4e11694744a86ae0b0e2fad907'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:51.918325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab35a4e11694744a86ae0b0e2fad907'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:51.919075 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab35a4e11694744a86ae0b0e2fad907'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:51.927615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab35a4e11694744a86ae0b0e2fad907'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:51.934322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1171/2347] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:38:51 2022] DELETE /identity/v3/users/eab35a4e11694744a86ae0b0e2fad907 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:51.938777 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:51.939335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:51.939335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:51.965649 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:51.967237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:52.048618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1177/2348] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:52.065748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:52.067420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:52.142168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd61fa-d2e3-4565-b03b-322f2c0e171c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:52.146417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:52.147213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:52.147515 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:52.147903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:52.158000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:52.159456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17e37-d301-4ba6-9c8c-5254a8b19450 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:52.171067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1172/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:52.684322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:52.685911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:52.703988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c17a3-e5d1-4c0a-b372-af54ae91a1fd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:52.713268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:52.714558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:52.715349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:52.715785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] PATH_INFO: `/v3/projects/4bdccf12e38845e0a8457f6f806fa4a7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:52.717562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdccf12e38845e0a8457f6f806fa4a7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:52.720069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:52.791100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdccf12e38845e0a8457f6f806fa4a7', 'request_id': 'req-95ac1db8-34de-4c37-8a41-5793153bf8c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:52.798561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdccf12e38845e0a8457f6f806fa4a7', 'request_id': 'req-95ac1db8-34de-4c37-8a41-5793153bf8c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:52.809847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdccf12e38845e0a8457f6f806fa4a7', 'request_id': 'req-95ac1db8-34de-4c37-8a41-5793153bf8c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:52.823705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] The token cache is being invalidate because project 4bdccf12e38845e0a8457f6f806fa4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:52.824005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:52.824860 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-95ac1db8-34de-4c37-8a41-5793153bf8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:52.828484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1178/2350] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:38:52 2022] DELETE /identity/v3/projects/4bdccf12e38845e0a8457f6f806fa4a7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:52.831529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:52.832016 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:52.832110 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:52.851758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:52.853454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:52.920618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1173/2351] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:52.928643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:52.929056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:52.929341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:52.947561 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:52.948826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:52.960624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1179/2352] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:52.961868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:52.972529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff893d9-d839-420e-858c-fe0508635b53 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:52.977524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:52.978195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:52.978475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:52.978747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:52.979475 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:38:52.979776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:52.981416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:52.993235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1174/2353] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:38:52.997958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.007643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e078c4-8873-482c-a04c-d803f3660197 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.012684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.013343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.013621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.013896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.014565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.016503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.044031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1180/2354] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:38:52 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:53.047948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.058316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7117d4a-e594-41c7-85a6-1c3a02f857f7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.112541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.113210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.113491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.113772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.114444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.116395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.137228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1175/2355] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:38:53 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:38:53.141455 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.151924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cbfc-a76e-458b-a43e-3035d9e639e7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.157181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.157851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.158120 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.158410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.159135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.160762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.176223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1181/2356] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:53.177489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.188835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbec64-1ca8-447d-aeb5-4cfbe54ac7a1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.193642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.194344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.194714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.194993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.195725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.197372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be42cf8-47b1-4137-abb4-b144d72011b8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.207528 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1176/2357] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:38:53.211926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.221795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca54e-3812-4d5f-b0c3-a69bb0bc1f96 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.226506 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.227393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.227673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.227951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] PATH_INFO: `/v3/projects/9167abc8182e47ab963f4aa1354182c8/users/7d0b497b2018496eb9432754b047ba99/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.242949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9167abc8182e47ab963f4aa1354182c8, user_id=7d0b497b2018496eb9432754b047ba99, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.245775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.260862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1182/2358] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:38:53 2022] PUT /identity/v3/projects/9167abc8182e47ab963f4aa1354182c8/users/7d0b497b2018496eb9432754b047ba99/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:38:53.271818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfede2-1e48-48d2-99b7-6bf3e1574aa6 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.272109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfede2-1e48-48d2-99b7-6bf3e1574aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.272390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfede2-1e48-48d2-99b7-6bf3e1574aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.299279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a2cfede2-1e48-48d2-99b7-6bf3e1574aa6 None None] MFA Rules not processed for user `7d0b497b2018496eb9432754b047ba99`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:38:53.301238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a2cfede2-1e48-48d2-99b7-6bf3e1574aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:53.374586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1177/2359] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:53.386136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:53.387967 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:53.449234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef157-6c0c-49f6-adbe-f4a4540455af admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:53.454236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:53.454795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:53.455080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:53.455354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:53.465997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:53.467653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:53.477608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1183/2360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:38:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:01.501640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:01.502186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:01.502553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:01.572344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:01.573865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:01.744053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1178/2361] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:01.816314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:01.818457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:01.956897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c503-d58a-4c13-8b56-a8be0a5bad28 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:01.962550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:01.964118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:01.964612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:01.965021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:01.973976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:01.976499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f01f78-eaad-4e4b-8360-d53b2e5308a4 service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:01.985140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1184/2362] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:39:06.077156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:06.179430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977403-8ddd-494f-b09a-7b3dd7499868 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:06.184270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:06.185379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:06.185820 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:06.186234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] PATH_INFO: `/v3/users/7d0b497b2018496eb9432754b047ba99` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:06.187718 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0b497b2018496eb9432754b047ba99)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:06.190241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:06.241932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0b497b2018496eb9432754b047ba99'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:06.257029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0b497b2018496eb9432754b047ba99'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:06.268794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0b497b2018496eb9432754b047ba99'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:06.270468 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0b497b2018496eb9432754b047ba99'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:06.280452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0b497b2018496eb9432754b047ba99'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:06.286942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1179/2363] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:39:06 2022] DELETE /identity/v3/users/7d0b497b2018496eb9432754b047ba99 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:06.291621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:06.292210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:06.292315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:06.341379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:06.342632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:06.437392 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1185/2364] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:06.451985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:06.459954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:06.619603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84a010-f0e6-4616-86d7-14e1ed719188 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:06.632904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:06.633932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:06.634399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:06.634920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:06.669310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:06.671806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75567dc-0b35-472f-becf-c6022e55daff service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:06.693913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1180/2365] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:07.094978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.096172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:07.128538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16f160-d10a-412d-a6ec-e3e702017ed0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.135895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.136835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.137125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.137545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] PATH_INFO: `/v3/projects/9167abc8182e47ab963f4aa1354182c8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.139318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9167abc8182e47ab963f4aa1354182c8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.148478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.230242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9167abc8182e47ab963f4aa1354182c8', 'request_id': 'req-44c8396a-81a2-45a0-a994-f447bb027130'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:07.236958 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9167abc8182e47ab963f4aa1354182c8', 'request_id': 'req-44c8396a-81a2-45a0-a994-f447bb027130'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:07.246746 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9167abc8182e47ab963f4aa1354182c8', 'request_id': 'req-44c8396a-81a2-45a0-a994-f447bb027130'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:07.259152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] The token cache is being invalidate because project 9167abc8182e47ab963f4aa1354182c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:39:07.259152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:07.259826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-44c8396a-81a2-45a0-a994-f447bb027130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:07.264923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1186/2366] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:39:07 2022] DELETE /identity/v3/projects/9167abc8182e47ab963f4aa1354182c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:07.266532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.267021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.267161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.324980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:07.326482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:07.406366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1181/2367] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:39:07.414941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.415504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.415504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.435138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:07.436614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:07.451869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1187/2368] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:07.456484 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.468822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb565db7-4ba3-419b-b03b-6117324e0511 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.477369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.478053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.478364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.478715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.479457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:39:07.479764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.481423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.496461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1182/2369] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:39:07.500501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.511969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdedf-fadc-4445-aef4-5b99df0f91a9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.521435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.522132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.522420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.525336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.525336 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.530739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.576489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1188/2370] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:39:07 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:39:07.577700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.604624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c751a-9d4c-4132-bb97-82b27de01a57 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.731161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.733632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.734085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.734541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.737302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.739438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.803149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.809531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1183/2371] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:39:07 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:39:07.815891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c815a-dd24-4c72-b366-ad7d05372c10 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.821329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.822308 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.822659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.822940 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.824005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.826145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.844627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1189/2372] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:39:07.846021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.859338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca6dd-9573-49f4-a234-63efc433cf78 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.873388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.874090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.874369 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.874638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.875380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.877770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83ea74-458d-4e87-ae12-66625163caf0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.891951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1184/2373] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:07.894284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:07.909822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcbfd4-6ad3-4953-b8e0-aa5f2bf2d6f4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:07.916115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:07.916980 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.917277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.917675 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] PATH_INFO: `/v3/projects/1260ab72bfde4bc9b3ba657ea0c18f14/users/e173bf0464c84f61b0b8f8ec071b61a9/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:07.936183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1260ab72bfde4bc9b3ba657ea0c18f14, user_id=e173bf0464c84f61b0b8f8ec071b61a9, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:07.939189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:07.956827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1190/2374] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:07 2022] PUT /identity/v3/projects/1260ab72bfde4bc9b3ba657ea0c18f14/users/e173bf0464c84f61b0b8f8ec071b61a9/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:07.962423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:07.962837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:07.963139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:08.006176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:08.007496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:08.149319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1185/2375] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:08.161547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:08.163622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:08.272912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44f2f-8d30-47b0-b41c-f406d7ed5170 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:08.281161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:08.282076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:08.282531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:08.282952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:08.293743 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:08.295388 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33de38-eab4-47d4-866e-69470d27af7e service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:08.307163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1191/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:39:10.044169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:10.048532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:10.095838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a8257-dd19-45f2-935e-9f7d4de36c46 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:10.104507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:10.105812 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:10.106331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:10.107233 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] PATH_INFO: `/v3/users/d61d8564f537409e8d81a1a0a8192e53` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:10.109712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61d8564f537409e8d81a1a0a8192e53)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:10.113173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:10.283801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61d8564f537409e8d81a1a0a8192e53'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:10.302962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61d8564f537409e8d81a1a0a8192e53'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:10.319605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61d8564f537409e8d81a1a0a8192e53'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:10.320419 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61d8564f537409e8d81a1a0a8192e53'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:10.336804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61d8564f537409e8d81a1a0a8192e53'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:10.346969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1186/2377] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:39:10 2022] DELETE /identity/v3/users/d61d8564f537409e8d81a1a0a8192e53 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:10.351325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:10.352368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:10.352897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:10.386501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:10.388204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:10.512331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1192/2378] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:10.528553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:10.531015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:10.635668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69034771-c799-42eb-a385-d9652146d81a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:10.645181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:10.646877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:10.647616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:10.647894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:10.661630 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:10.664572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee51df-a6ab-4386-a941-6764e2f2c0ec service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:10.679259 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1187/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:11.547636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:11.549951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:11.573720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a04f-c103-43de-942a-616c2300b0bf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:11.585091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:11.586084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:11.586429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:11.589112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] PATH_INFO: `/v3/projects/4eebbd7a278542fbbd3a886a2c5dc2d5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:11.592641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eebbd7a278542fbbd3a886a2c5dc2d5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:11.604590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:11.726562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eebbd7a278542fbbd3a886a2c5dc2d5', 'request_id': 'req-65562dac-7d9a-471f-89eb-be9e8990bca6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:11.741770 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eebbd7a278542fbbd3a886a2c5dc2d5', 'request_id': 'req-65562dac-7d9a-471f-89eb-be9e8990bca6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:11.767522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eebbd7a278542fbbd3a886a2c5dc2d5', 'request_id': 'req-65562dac-7d9a-471f-89eb-be9e8990bca6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:11.789807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] The token cache is being invalidate because project 4eebbd7a278542fbbd3a886a2c5dc2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:39:11.790109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:11.791904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-65562dac-7d9a-471f-89eb-be9e8990bca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:11.794901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1193/2380] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:39:11 2022] DELETE /identity/v3/projects/4eebbd7a278542fbbd3a886a2c5dc2d5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:11.802423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:11.802954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:11.803068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:11.928041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:11.929332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:12.105586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1188/2381] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:12.113403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.113692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.113970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.154101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:12.155386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:12.171263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1194/2382] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:12.175831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.195779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0aa8b-f9c5-4de0-a7a4-6f5595a7f80f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.228479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.231287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.231560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.231832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.232626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:39:12.232942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.234596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.248319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1189/2383] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:39:12.253815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.291183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f125abc-1a49-4bdf-ba20-bc247782bded None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.298097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.298915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.299293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.299719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.301154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.309483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.368472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1195/2384] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:39:12 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:39:12.372225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.394236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afa66-357f-4f66-a4d4-85ca3ccc7889 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.490492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.491509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.491949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.492383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.493442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.496399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.526533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1190/2385] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:39:12 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:39:12.527804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.541002 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4550-a451-4ead-aa40-1b8a75b4651d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.561983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.564404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.564714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.567888 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.568735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.580715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.613219 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1196/2386] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:12.614464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.628497 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5011-578b-4d43-be5a-0abde9bf57be admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.638437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.640621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.640919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.641979 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.643851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.645572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e6f9-59a1-49f2-bd4f-ac33b925decd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.669127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1191/2387] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:12.673401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.687838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a6ef-cfd3-455d-8f99-19445928aac2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:12.703174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:12.704043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.704279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.704766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] PATH_INFO: `/v3/projects/710ecde5160640149c693e0c2b0b0354/users/6fa431ce09e44b85b61af972bbce2ed4/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.727897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710ecde5160640149c693e0c2b0b0354, user_id=6fa431ce09e44b85b61af972bbce2ed4, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:12.730710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:12.749056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1197/2388] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:12 2022] PUT /identity/v3/projects/710ecde5160640149c693e0c2b0b0354/users/6fa431ce09e44b85b61af972bbce2ed4/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:12.758274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884208-cee5-4908-a6ae-632d29b4401d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:12.758895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884208-cee5-4908-a6ae-632d29b4401d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:12.759348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884208-cee5-4908-a6ae-632d29b4401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:12.786065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3d884208-cee5-4908-a6ae-632d29b4401d None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:12.787322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3d884208-cee5-4908-a6ae-632d29b4401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:12.883997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1192/2389] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:12.894140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:12.897274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:13.040164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b626b73-24fc-4c0f-a404-0580ed6d1b52 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:13.076850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:13.076850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:13.077209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:13.077293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:13.115379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:13.117447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:13.146841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1198/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:17.259876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.260420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.260420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.291347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] MFA Rules not processed for user `e173bf0464c84f61b0b8f8ec071b61a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:17.292696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:17.362899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1193/2391] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:17.367727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.369251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:17.382021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692df9-027a-40dc-8568-b380cba8c1cc service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.386912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.387581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.388040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.388504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.389364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.391457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.438136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1199/2392] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:39:17 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:39:17.442008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.457002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f26a0e-a14f-4d3c-b203-df5467c48e3c None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.562265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.563577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.564051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.564714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.565686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.567983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.599501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1194/2393] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:39:17 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:39:17.603064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.616330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ef3aa-9392-4516-8f6a-080827f4c058 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.626218 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.627851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.628295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.628772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.630384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.632201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.646597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1200/2394] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:17.650915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.684292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd45bc-4842-48a0-9646-16a6dde38f13 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.699237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.700423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.700920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.701882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] PATH_INFO: `/v3/projects/6d5b856567154f82be7131a50db06412/users/139a09f765954a4093c59c7167c5ccd4/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.740669 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5b856567154f82be7131a50db06412, user_id=139a09f765954a4093c59c7167c5ccd4, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.743962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.770616 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1195/2395] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:17 2022] PUT /identity/v3/projects/6d5b856567154f82be7131a50db06412/users/139a09f765954a4093c59c7167c5ccd4/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:17.774728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.792569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cadda-963b-4c9e-82c0-65ffae3fa024 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.891794 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.893396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.893873 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.894310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.895379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.898289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d996-9b6d-4d28-ae0b-b9776c96ef6c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.916493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1201/2396] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:17.919193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:17.948169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66d99-05f1-4287-89e9-bc611007e259 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:17.962057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:17.963125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:17.963591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:17.964058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] PATH_INFO: `/v3/projects/6d5b856567154f82be7131a50db06412/users/139a09f765954a4093c59c7167c5ccd4/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:17.966493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5b856567154f82be7131a50db06412, user_id=139a09f765954a4093c59c7167c5ccd4, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:17.969411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:17.981295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1196/2397] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:17 2022] PUT /identity/v3/projects/6d5b856567154f82be7131a50db06412/users/139a09f765954a4093c59c7167c5ccd4/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:21.336937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:21.338249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:21.338716 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:21.430073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] MFA Rules not processed for user `6fa431ce09e44b85b61af972bbce2ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:21.433329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:21.622955 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1202/2398] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:21.628321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:21.764678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313449b-8baa-4ce5-b617-373b851c6225 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:21.777079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:21.777962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:21.779124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:21.779588 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:21.782502 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:21.787132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:21.882731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:21.886577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1197/2399] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:39:21 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:39:21.902405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4250b-bf5f-4e40-a35d-f4e688e3ef6e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.137147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.137858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.138139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.138414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.139127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:22.141231 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:22.210292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1203/2400] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:39:21 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:39:22.214621 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:22.234651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856e96-4914-473c-8f1d-9fcb7fc6bfa1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.259162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.259892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.260179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.260469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.271313 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:22.274326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:22.293213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1198/2401] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:39:22.296558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:22.313930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b3d66-4ecf-4281-97dd-ce0c57b3d00a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.321660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.322584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.322864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.323140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] PATH_INFO: `/v3/projects/470cc6e3395540ab8047886dbb5a8551/users/b631576565c8472ea2d23a6cefbb8916/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.348319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] RBAC: Authorizing `identity:create_grant(project_id=470cc6e3395540ab8047886dbb5a8551, user_id=b631576565c8472ea2d23a6cefbb8916, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:22.358245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba1f6-b438-4ae5-ab56-a62f308e606c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:22.385284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1204/2402] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:22 2022] PUT /identity/v3/projects/470cc6e3395540ab8047886dbb5a8551/users/b631576565c8472ea2d23a6cefbb8916/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:22.397129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:22.430961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bfecf-d8de-497a-a0dd-a3d648caca81 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.521037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4614-da4e-47fc-88be-7b3864a3d9a4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.521593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4614-da4e-47fc-88be-7b3864a3d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.522033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4614-da4e-47fc-88be-7b3864a3d9a4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.523624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1205/2403] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:39:22.541609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41c90-a6ac-4b3d-a034-dcf7cd635ca8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.541890 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41c90-a6ac-4b3d-a034-dcf7cd635ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.542340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41c90-a6ac-4b3d-a034-dcf7cd635ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.642927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.643559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.643847 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.644129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.652426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:22.663150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:22.679250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1199/2404] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:39:22.684614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:22.717472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3db41c90-a6ac-4b3d-a034-dcf7cd635ca8 None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:22.718946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3db41c90-a6ac-4b3d-a034-dcf7cd635ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:22.721697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-c375-4740-953d-bba3c5ae625e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.735581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.736596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.736880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.737148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] PATH_INFO: `/v3/projects/470cc6e3395540ab8047886dbb5a8551/users/b631576565c8472ea2d23a6cefbb8916/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:22.739690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=470cc6e3395540ab8047886dbb5a8551, user_id=b631576565c8472ea2d23a6cefbb8916, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:22.742845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:22.756823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1200/2405] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:39:22 2022] PUT /identity/v3/projects/470cc6e3395540ab8047886dbb5a8551/users/b631576565c8472ea2d23a6cefbb8916/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:22.845781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1206/2406] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 16 20:39:22.860632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:22.862668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:22.960955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d2db9-2d7f-4334-bf2a-21f468db9c9a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:22.968634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:22.969949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:22.970446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:22.970708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.136108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:23.137805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac468c-bfcd-4ffc-b7a1-8da5ba82e667 service glance] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:23.159069 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1201/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:39:23.284830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.285145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.285428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.287109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1207/2408] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:39:23.296778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f045-fbc8-4316-a237-83d49434955e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.298316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f045-fbc8-4316-a237-83d49434955e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.298623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f045-fbc8-4316-a237-83d49434955e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.344674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bde6f045-fbc8-4316-a237-83d49434955e None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:23.348543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bde6f045-fbc8-4316-a237-83d49434955e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:23.487673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1202/2409] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:23.506726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:23.508901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:23.538181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe6d60-562e-4d9e-a7cf-75a4034ea03e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:23.543942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:23.545554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.546503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.547190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.571003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:23.583025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7496-07e5-4af9-ab1a-b9cacee6c813 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:23.594422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1208/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:23.748340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd205-c51a-4c81-bdc2-78eecab53343 None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.748967 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd205-c51a-4c81-bdc2-78eecab53343 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.749321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd205-c51a-4c81-bdc2-78eecab53343 None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.751118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1203/2411] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:39:23.764584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cfd-dcda-4227-88fa-a73583dc9edb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.764882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cfd-dcda-4227-88fa-a73583dc9edb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.765176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cfd-dcda-4227-88fa-a73583dc9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:23.833433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e3667cfd-dcda-4227-88fa-a73583dc9edb None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:23.835271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e3667cfd-dcda-4227-88fa-a73583dc9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:23.862286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1209/2412] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:23.910175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd205-c51a-4c81-bdc2-78eecab53343 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:23.929499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd205-c51a-4c81-bdc2-78eecab53343 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:23.936019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:23.944584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:23.945311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:23.949205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:24.005095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:24.012706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:24.047301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1204/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:25.978949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:25.980298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:25.982092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:26.082937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] MFA Rules not processed for user `139a09f765954a4093c59c7167c5ccd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:26.086537 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:26.265653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1210/2414] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:26.281312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:26.297208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebc302-1bed-4ef2-8c85-e65827a13b28 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:26.302960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:26.303991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:26.305285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:26.305916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:26.381838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:26.384160 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:26.439307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:26.442105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192689a-0069-475e-9577-d4c2c67a7928 service glance] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:26.469357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1205/2415] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:26.499397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a09d5-4774-47f3-ad7a-61cd55cc350c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:26.507837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:26.509509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:26.512290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:26.535880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] PATH_INFO: `/v3/users/61a9696a518b4d43a9f2129f6154d5fd` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:26.537712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a9696a518b4d43a9f2129f6154d5fd)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:26.541875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:26.665139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:26.665496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:26.665976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:26.691996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a9696a518b4d43a9f2129f6154d5fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:26.692889 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a9696a518b4d43a9f2129f6154d5fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:26.712746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:26.714336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:26.728095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a9696a518b4d43a9f2129f6154d5fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:26.742721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a9696a518b4d43a9f2129f6154d5fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:26.769667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a9b8d20e-eda3-4c13-b7f3-4978c53f684c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a9696a518b4d43a9f2129f6154d5fd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:26.779238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1211/2416] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:39:26 2022] DELETE /identity/v3/users/61a9696a518b4d43a9f2129f6154d5fd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:39:26.784555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:26.785073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:26.785536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:26.815956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:26.817512 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:26.841405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1206/2417] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 16 20:39:26.855447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:26.857534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:26.949973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1212/2418] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:26.958455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df025ea3-9062-4e28-bdd5-ddb037ef7041 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:26.962402 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:26.964541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:27.028146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:27.029226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:27.029736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:27.030232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:27.077313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88890-9e3f-4de3-8402-581f7bd6d4fa None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:27.081434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:27.082137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:27.082381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:27.082660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:27.094042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:27.096043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea2a8-b1a5-41f1-954c-15e13c3bc239 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:27.109163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1213/2419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:39:27.109627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:27.111590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:27.122206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1207/2420] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:39:28.299141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:28.299720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:28.299920 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:28.354679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:28.356550 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:28.380012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1214/2421] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:39:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:28.394092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:28.405266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5be19-5f77-4622-bdbd-e56c4e338d8c service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:28.429518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:28.430517 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:28.431040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:28.431472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:28.449256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:28.451274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23010be-8d11-46e5-a548-acf10a2d1af4 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:28.464639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1208/2422] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:39:28.817101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:28.818758 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:28.865733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56bb16-5686-47c3-acaa-2b44e9516291 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:28.917642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:28.918551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:28.918846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:28.919111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] PATH_INFO: `/v3/projects/ce2d9351f88241bfa8406d6b6e3ec82f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:28.933181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2d9351f88241bfa8406d6b6e3ec82f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:28.944295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:29.110546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2d9351f88241bfa8406d6b6e3ec82f', 'request_id': 'req-5412ae13-5b23-4b6c-a150-05dbe63387b0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:29.120140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2d9351f88241bfa8406d6b6e3ec82f', 'request_id': 'req-5412ae13-5b23-4b6c-a150-05dbe63387b0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:29.132824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2d9351f88241bfa8406d6b6e3ec82f', 'request_id': 'req-5412ae13-5b23-4b6c-a150-05dbe63387b0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:29.189864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] The token cache is being invalidate because project ce2d9351f88241bfa8406d6b6e3ec82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:39:29.190396 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:29.191230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:39:29.194180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1215/2423] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:39:28 2022] DELETE /identity/v3/projects/ce2d9351f88241bfa8406d6b6e3ec82f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:39:33.084192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986d13-4248-457c-a350-1ee389cfd59e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:33.085263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986d13-4248-457c-a350-1ee389cfd59e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:33.085854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986d13-4248-457c-a350-1ee389cfd59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:33.154819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5b986d13-4248-457c-a350-1ee389cfd59e None None] MFA Rules not processed for user `b631576565c8472ea2d23a6cefbb8916`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:33.156582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5b986d13-4248-457c-a350-1ee389cfd59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:33.290792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1209/2424] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:33.306876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:33.308307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:33.431201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ae13-5b23-4b6c-a150-05dbe63387b0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:33.443194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:33.444626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:33.445252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:33.446058 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:33.449302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:33.567652 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:33.570505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d7f5-623a-490e-8f5c-6d5e2016d6b2 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:33.582342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1216/2425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:39:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:39:43.310236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:43.310794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:43.310794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:43.327760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] MFA Rules not processed for user `e173bf0464c84f61b0b8f8ec071b61a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:43.328969 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:43.384305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1210/2426] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:46.343552 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b8b2-c9b9-4af3-8efa-f2118e846453 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:46.344060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b8b2-c9b9-4af3-8efa-f2118e846453 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:46.344141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b8b2-c9b9-4af3-8efa-f2118e846453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:46.407762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-61e6b8b2-c9b9-4af3-8efa-f2118e846453 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:39:46.409026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-61e6b8b2-c9b9-4af3-8efa-f2118e846453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:46.475607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1217/2427] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:39:46.488981 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:39:46.490487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:39:46.617664 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c028-ef5d-4afd-9519-b805038ab546 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:39:46.624896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:39:46.625677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:39:46.626042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:39:46.626381 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:39:46.644833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:39:46.646637 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:39:46.664957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1211/2428] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:40:00.152816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b590-e16d-4e03-b517-609ced110960 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:00.153374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b590-e16d-4e03-b517-609ced110960 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:00.153374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b590-e16d-4e03-b517-609ced110960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:00.170739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5483b590-e16d-4e03-b517-609ced110960 None None] MFA Rules not processed for user `6fa431ce09e44b85b61af972bbce2ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:40:00.171928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5483b590-e16d-4e03-b517-609ced110960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:00.179585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1218/2429] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:40:04.087406 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:40:04.089531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:04.202489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51020e-8153-4456-b188-8399081266f2 service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:40:04.208091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:40:04.208796 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:04.209080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:04.209357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:04.211287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:04.223976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:40:04.225654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:40:04.236002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1212/2430] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:40:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:40:10.645887 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05b4a-7249-4b5f-a300-c681ce4abc64 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:10.646418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05b4a-7249-4b5f-a300-c681ce4abc64 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:10.646418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05b4a-7249-4b5f-a300-c681ce4abc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:10.665399 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ade05b4a-7249-4b5f-a300-c681ce4abc64 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:40:10.666639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ade05b4a-7249-4b5f-a300-c681ce4abc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:10.674049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1219/2431] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:40:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:40:10.697135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:40:10.708070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f93d9-bc2b-4815-b191-28055e9f440c service placement] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:40:10.714913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:40:10.716059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:10.716059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:10.716215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:10.725200 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:40:10.726786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a87b6-2f89-4d99-89f9-cb41485454b1 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:40:10.746873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1213/2432] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:40:12.341483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:12.342044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:12.342044 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:12.372677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] MFA Rules not processed for user `20c57f1318cd4c73b2248b2d02896176`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:40:12.373905 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:12.430014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1220/2433] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:40:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:40:21.370763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:21.370763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:21.371225 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:21.389628 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] MFA Rules not processed for user `b578680e88c741bda2c8e56b2dc9d335`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:40:21.390990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:21.450370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1214/2434] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:40:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:40:22.606444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:40:22.608032 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:22.670542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6d90-ff91-46ea-ab23-6babaaa80e9c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:40:22.674666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:40:22.675329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:22.676006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:22.676273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:22.690398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:40:22.692121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5e0ce-3e94-4edb-a865-a8105f3adc5f service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:40:22.716251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1221/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:40:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:40:23.825344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:40:23.834671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a289ba3-7c80-43f9-a11d-32fcb5954e02 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:40:23.838681 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:40:23.839336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:40:23.839617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:40:23.839903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:40:23.841741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:40:23.912776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:40:23.914457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551c1-c5e7-4aad-a1e9-723e2e000449 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:40:23.926680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1215/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:41:07.348903 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193834-d027-4f97-abf1-99307cc1bbfa None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:41:07.349460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193834-d027-4f97-abf1-99307cc1bbfa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:41:07.349460 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193834-d027-4f97-abf1-99307cc1bbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:41:07.366902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ea193834-d027-4f97-abf1-99307cc1bbfa None None] MFA Rules not processed for user `de3dd9262fba4830be6c4477628f2061`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:41:07.368086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ea193834-d027-4f97-abf1-99307cc1bbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:07.423133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1222/2437] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:41:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:41:36.518024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:41:36.518567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:41:36.518567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:41:36.536994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] MFA Rules not processed for user `20c57f1318cd4c73b2248b2d02896176`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:41:36.538168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:36.546404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1216/2438] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:41:42.857437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:41:42.858009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:41:42.858009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:41:42.876509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] MFA Rules not processed for user `b578680e88c741bda2c8e56b2dc9d335`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:41:42.877729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:42.885927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1223/2439] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:41:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:41:49.259450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:41:49.262302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:49.281109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ec51-7505-42d5-b588-18a688bf823e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:41:49.285184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:41:49.285833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:41:49.286111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:41:49.286382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:41:49.288218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:49.304461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:41:49.305893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:41:49.317172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1217/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:41:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:41:50.505249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:41:50.515757 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70000aa-907d-48f0-88c9-1225bb1e0f0f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:41:50.520539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:41:50.521221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:41:50.521500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:41:50.521769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:41:50.523826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:41:50.538045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:41:50.539441 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:41:50.550787 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1224/2441] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:41:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:03.789350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:03.799165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75cd2-db09-4557-bde5-c4dff7df7514 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:03.803079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:03.804398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:03.804716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:03.805158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:03.807030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:03.819404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:03.820921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:03.831076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1218/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:04.287087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:04.298953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b799f3-c396-4966-818e-7d22104814d6 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:04.304990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:04.305648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:04.305930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:04.306208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:04.308104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:04.323484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:04.325204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5392-6dd2-4b43-ab94-c9dc210571ab service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:04.335646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1225/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:08.044460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:08.060896 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de0c3-aa8b-4382-9ba0-97eaed0cd5b6 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:08.067559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:08.068307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:08.068921 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:08.069273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:08.071163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:08.085185 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:08.086876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:08.098659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1219/2444] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:09.110043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:09.110511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:09.110608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:09.129844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:09.131101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:09.138778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1226/2445] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:09.190672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:09.202015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3f01-e3f9-4adc-8197-e4765ea3eb9b service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:09.207618 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:09.208342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:09.208720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:09.209057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:09.217823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:09.219402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:09.227522 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1220/2446] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:42:16.083474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:16.085147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:16.157882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f12e3-4b86-4f22-b39d-829f16d19895 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:16.162266 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:16.163139 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:16.163417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:16.163719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] PATH_INFO: `/v3/users/e173bf0464c84f61b0b8f8ec071b61a9` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:16.165140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e173bf0464c84f61b0b8f8ec071b61a9)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:16.167064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:16.217078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e173bf0464c84f61b0b8f8ec071b61a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.217719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e173bf0464c84f61b0b8f8ec071b61a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.229574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e173bf0464c84f61b0b8f8ec071b61a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.236717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e173bf0464c84f61b0b8f8ec071b61a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.245335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e173bf0464c84f61b0b8f8ec071b61a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.251024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1227/2447] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:16 2022] DELETE /identity/v3/users/e173bf0464c84f61b0b8f8ec071b61a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:16.491412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:16.502550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20560218-7b98-498d-adf5-67101ec1199c service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:16.569239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:16.570117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:16.570395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:16.570671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] PATH_INFO: `/v3/projects/1260ab72bfde4bc9b3ba657ea0c18f14` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:16.571870 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1260ab72bfde4bc9b3ba657ea0c18f14)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:16.574350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:16.621302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1260ab72bfde4bc9b3ba657ea0c18f14', 'request_id': 'req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.626968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1260ab72bfde4bc9b3ba657ea0c18f14', 'request_id': 'req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.637814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1260ab72bfde4bc9b3ba657ea0c18f14', 'request_id': 'req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.650915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] The token cache is being invalidate because project 1260ab72bfde4bc9b3ba657ea0c18f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:16.651205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.651996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.653860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1221/2448] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:16 2022] DELETE /identity/v3/projects/1260ab72bfde4bc9b3ba657ea0c18f14 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:16.661420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:16.663039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:16.676529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d714cd-39f0-4013-90be-8448490a0b73 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:16.732072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:16.732926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:16.733208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:16.733478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] PATH_INFO: `/v3/users/139a09f765954a4093c59c7167c5ccd4` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:16.734667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=139a09f765954a4093c59c7167c5ccd4)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:16.736654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:16.783368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139a09f765954a4093c59c7167c5ccd4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.784026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139a09f765954a4093c59c7167c5ccd4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.795841 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139a09f765954a4093c59c7167c5ccd4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.803481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139a09f765954a4093c59c7167c5ccd4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.812811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0de9d9c5-485e-4580-98ca-bff71d5fd9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139a09f765954a4093c59c7167c5ccd4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:16.819366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1228/2449] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:16 2022] DELETE /identity/v3/users/139a09f765954a4093c59c7167c5ccd4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:16.997145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:16.998695 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:17.011770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f10ce-f1fb-4d9b-b79a-83f6f2c9843d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:17.072124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:17.073089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:17.073375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:17.073653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] PATH_INFO: `/v3/projects/6d5b856567154f82be7131a50db06412` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:17.074863 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5b856567154f82be7131a50db06412)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:17.076961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:17.123121 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5b856567154f82be7131a50db06412', 'request_id': 'req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:17.128336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5b856567154f82be7131a50db06412', 'request_id': 'req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:17.135221 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5b856567154f82be7131a50db06412', 'request_id': 'req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:17.146905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] The token cache is being invalidate because project 6d5b856567154f82be7131a50db06412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:17.147192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:17.147839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:17.149835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1222/2450] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:16 2022] DELETE /identity/v3/projects/6d5b856567154f82be7131a50db06412 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:25.201340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:25.201824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:25.201930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:25.219753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:25.221025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:25.277848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1229/2451] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:42:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:25.293349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:25.296038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:25.375454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4e188-ac52-402c-8f0c-f93b0a9f11ce admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:25.380797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:25.381457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:25.381745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:25.382029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:25.390565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:25.392133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:25.400454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1223/2452] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:42:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:42:34.460711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:34.462064 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:34.536717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addd76b-601a-4584-ab10-63e9e2e407ff None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:34.542519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:34.543162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:34.543447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:34.543728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:34.545663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:34.610112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:34.612511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:34.625222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1230/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:37.090949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:37.104100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cea58-9721-42f7-a090-1acb11aad54c service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:37.110747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:37.111429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:37.111899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:37.112346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:37.114477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:37.129821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:37.131761 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0635-f411-4f9b-8b3a-cfdfbcc6a3ac service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:37.157204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1224/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:40.014697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.016982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.088829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3afc3-b228-46a2-b0a8-50c538b1e55b service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.093913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.094782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.095086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.095423 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] PATH_INFO: `/v3/users/20c57f1318cd4c73b2248b2d02896176` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.097100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c57f1318cd4c73b2248b2d02896176)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.099156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.152474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c57f1318cd4c73b2248b2d02896176'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.153313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c57f1318cd4c73b2248b2d02896176'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.165712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c57f1318cd4c73b2248b2d02896176'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.172730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c57f1318cd4c73b2248b2d02896176'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.185515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c57f1318cd4c73b2248b2d02896176'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.194227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1231/2455] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:40 2022] DELETE /identity/v3/users/20c57f1318cd4c73b2248b2d02896176 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:40.341150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.341638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.341737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.360740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] MFA Rules not processed for user `6fa431ce09e44b85b61af972bbce2ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:40.362059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.373242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.374870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.464997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1225/2456] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:40.476457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eccc30-e654-4228-81fc-93b0eb8b3df2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.482096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.483327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.483668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.484155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] PATH_INFO: `/v3/projects/69e39fae43c341798f00e3b48f20d003` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.487632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e39fae43c341798f00e3b48f20d003)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.489852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.552929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.554625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.583289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e39fae43c341798f00e3b48f20d003', 'request_id': 'req-e8bfe280-3015-445b-8851-e82fdd3f3969'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.595580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e39fae43c341798f00e3b48f20d003', 'request_id': 'req-e8bfe280-3015-445b-8851-e82fdd3f3969'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.617026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e39fae43c341798f00e3b48f20d003', 'request_id': 'req-e8bfe280-3015-445b-8851-e82fdd3f3969'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.631502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] The token cache is being invalidate because project 69e39fae43c341798f00e3b48f20d003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:40.632167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.637969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e8bfe280-3015-445b-8851-e82fdd3f3969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:40.640089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1232/2457] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:40 2022] DELETE /identity/v3/projects/69e39fae43c341798f00e3b48f20d003 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:40.645039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ad2a-3140-4489-9883-f10442912bd2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.645434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ad2a-3140-4489-9883-f10442912bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.645819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ad2a-3140-4489-9883-f10442912bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.663036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d613fce-b5dd-42bb-bec3-eeb2c41c59da None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.665798 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0d30ad2a-3140-4489-9883-f10442912bd2 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:40.667220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0d30ad2a-3140-4489-9883-f10442912bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.727769 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1233/2458] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:42:40.730464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.731200 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.731545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.731882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.733887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.738097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.738509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.738886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.746073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.747705 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.759153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1226/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:42:40.759830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:40.761304 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.769576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1234/2460] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:40.773775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.787237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780d91c-1e6b-4ecf-bcb8-a4931f6028f1 service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.792985 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.793763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.794106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.794446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.795521 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:42:40.795898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.797790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.810118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1227/2461] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:42:40.813976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.814270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.815466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.824056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd417c-59cf-4f9a-bdbd-f3152190c37e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.829169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.829937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.830286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.830741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.831495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.833610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.860153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1228/2462] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:40 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:42:40.861578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:40.863211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.874989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17e285-336e-43f5-b3ce-63bdd9b6fcf9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.917506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028af8d-652d-4fb0-9748-4425d57ff1ff admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:40.921291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.921641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:40.921942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.922220 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.922322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:40.922493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.922590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:40.922829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:40.924351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.924841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:40.934038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.934924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:40.935463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.936580 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:40.944484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1235/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:40.944638 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1229/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:40.945222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.012307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108274b8-f273-466d-82d6-5f56862bd6eb service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.017288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.017964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.018306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.018584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.019282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.021322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380bee9-a50b-4177-afd8-ebadd1885e7d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.057645 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1236/2465] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:40 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:41.058619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.075403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545bd2-eb56-48f7-a843-0dbc6f64b3eb service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.089748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a1cc-c26a-41f7-93ea-50fa004001f1 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.090368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a1cc-c26a-41f7-93ea-50fa004001f1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.090904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a1cc-c26a-41f7-93ea-50fa004001f1 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.092683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1237/2466] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:42:41.094066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.094904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.100800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.100800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.100800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.100800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.102838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.103316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.103732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.111578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1230/2467] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:42:41.119155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.137320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:41.138257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3380ce9-f39a-4629-a8e1-9b77783936d5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.139607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.151038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.151947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.152428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.153244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.154366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.156363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.181308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1231/2468] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:41.186498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.200264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa227e0-1e7d-4f04-b138-80530781f8e7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.206862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.207766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.208165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.208425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] PATH_INFO: `/v3/projects/60401cedf16e4ac0a81019a900ea0648/users/fc89b55d5a514d099a7a8f7f1ed9bd4e/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.221644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1238/2469] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:41.231322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60401cedf16e4ac0a81019a900ea0648, user_id=fc89b55d5a514d099a7a8f7f1ed9bd4e, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.234338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ad99f-e9d4-4035-8ac4-a175498df870 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.236765 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.238878 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.256523 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1232/2470] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:41 2022] PUT /identity/v3/projects/60401cedf16e4ac0a81019a900ea0648/users/fc89b55d5a514d099a7a8f7f1ed9bd4e/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:41.265946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.266232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.266504 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.298602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] MFA Rules not processed for user `fc89b55d5a514d099a7a8f7f1ed9bd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:41.299798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.326003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8454d5-704f-456b-9a89-987a7bb90ede None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.371331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1233/2471] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:41.375880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.380283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.381024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.381705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.381705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.455780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c022fc-c1e4-4eb4-9faa-6f285ac52058 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.461184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.461885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.462179 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.462454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.463149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.463281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.464930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.465218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.487663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1239/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:42:41.500975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1234/2473] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:41.505530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.521071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f743a-e6d7-460a-bca1-e2af38b9606e service glance] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.528122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.529940 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.586429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.587108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.587391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.587665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.588357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.590364 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee7e1-cd63-4e15-ac6b-54a2d198f7ec admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.612925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1240/2474] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:42:41.612925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30835-9492-4e0b-92ee-ec1d70f57086 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.612925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30835-9492-4e0b-92ee-ec1d70f57086 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.612925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30835-9492-4e0b-92ee-ec1d70f57086 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.613680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1241/2475] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:42:41.617428 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30835-9492-4e0b-92ee-ec1d70f57086 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.617565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb795-90cf-424b-83ae-a7d858031dae admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.622686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.623538 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.623890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.624235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.626081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.629829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30835-9492-4e0b-92ee-ec1d70f57086 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.637105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.637105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.637105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.637105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.637614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.637703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.637900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa9d4-b351-42d9-9f41-02e574e7c4bc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.639332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.651316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1242/2476] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:41.651316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.651602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1235/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:41.651808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.652104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.658154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.664629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151dd76-e36c-44c7-97e2-e1b6ad41e44c service placement] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.669437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.670591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.670946 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.671286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] PATH_INFO: `/v3/projects/bcfa139291d2467aa92b83ed6630cebb/users/419a01a216c647e3badc5b1dd23c9b14/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.692453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] MFA Rules not processed for user `3095aa719bfd4f6e803ade0e33e09697`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:41.693921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.695303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa139291d2467aa92b83ed6630cebb, user_id=419a01a216c647e3badc5b1dd23c9b14, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.698135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.718329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1236/2478] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:41 2022] PUT /identity/v3/projects/bcfa139291d2467aa92b83ed6630cebb/users/419a01a216c647e3badc5b1dd23c9b14/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:41.722708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.772118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1243/2479] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:41.785472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.794186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1ba2-3c53-476f-ae21-92a708b66274 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.797235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2018b-ad36-4b8a-9dc3-fcd8e1b7d503 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.799405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.800150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.800519 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.800859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.801679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.803382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.817119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1237/2480] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:42:41.818305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.830951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51cfea-9ca6-422e-b55b-faa1b613e44d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:41.837208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.838116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.838391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.838671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] PATH_INFO: `/v3/projects/bcfa139291d2467aa92b83ed6630cebb/users/419a01a216c647e3badc5b1dd23c9b14/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.841244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa139291d2467aa92b83ed6630cebb, user_id=419a01a216c647e3badc5b1dd23c9b14, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.844917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229027-ade7-4d92-b89b-b0bdaac1f0d4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.852998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:41.853653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.854057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.854334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.856274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1238/2481] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:41 2022] PUT /identity/v3/projects/bcfa139291d2467aa92b83ed6630cebb/users/419a01a216c647e3badc5b1dd23c9b14/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:41.862131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:41.863568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:41.867391 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:41.867738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:41.868152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:41.872176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1244/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:42:41.900838 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] MFA Rules not processed for user `419a01a216c647e3badc5b1dd23c9b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:41.902163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:41.977470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1239/2483] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:41.989748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:41.991277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:42.074816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8d761-f667-4934-ad99-16cab774e452 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:42.135043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:42.136006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:42.136391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:42.136795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:42.150617 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:42.152837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72433979-e793-4132-8c54-7648cd4996e5 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:42.164405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1245/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:42:42.306261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:42.367118 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd5a4-096c-4c8c-abed-c0baaea73f1e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:42.373270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:42.374238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:42.374500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:42.374777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] PATH_INFO: `/v3/users/fc89b55d5a514d099a7a8f7f1ed9bd4e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:42.377183 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc89b55d5a514d099a7a8f7f1ed9bd4e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:42.385239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:42.475902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc89b55d5a514d099a7a8f7f1ed9bd4e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:42.485674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc89b55d5a514d099a7a8f7f1ed9bd4e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:42.494922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc89b55d5a514d099a7a8f7f1ed9bd4e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:42.495861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc89b55d5a514d099a7a8f7f1ed9bd4e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:42.508880 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc89b55d5a514d099a7a8f7f1ed9bd4e'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:42.516290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1240/2485] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:42 2022] DELETE /identity/v3/users/fc89b55d5a514d099a7a8f7f1ed9bd4e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:42.521657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:42.521950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:42.522232 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:42.552555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:42.553961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:42.615096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1246/2486] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:42.625088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:42.626626 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:42.684957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e8e86-cf70-476d-af4a-e4ab0d467a34 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:42.688876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:42.689529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:42.689815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:42.690092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:42.698959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:42.700394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:42.709645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1241/2487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:43.043265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:43.044795 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:43.057078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e214-2622-46d7-8a0b-186c43eab22f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:43.061704 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:43.062578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:43.062859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:43.063132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] PATH_INFO: `/v3/projects/60401cedf16e4ac0a81019a900ea0648` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:43.064360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60401cedf16e4ac0a81019a900ea0648)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:43.066363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:43.112773 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60401cedf16e4ac0a81019a900ea0648', 'request_id': 'req-cb51b8dd-512f-4962-84c8-6134efa1c741'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.118898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60401cedf16e4ac0a81019a900ea0648', 'request_id': 'req-cb51b8dd-512f-4962-84c8-6134efa1c741'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.132004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60401cedf16e4ac0a81019a900ea0648', 'request_id': 'req-cb51b8dd-512f-4962-84c8-6134efa1c741'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.145082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] The token cache is being invalidate because project 60401cedf16e4ac0a81019a900ea0648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:43.145560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.146241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.147834 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1247/2488] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:43 2022] DELETE /identity/v3/projects/60401cedf16e4ac0a81019a900ea0648 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:43.152775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:43.178891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42d03-eb1b-4c22-8ea6-694a0f7acab5 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:43.261892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:43.262801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:43.263082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:43.263353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] PATH_INFO: `/v3/users/419a01a216c647e3badc5b1dd23c9b14` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:43.264929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419a01a216c647e3badc5b1dd23c9b14)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:43.266893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:43.329591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419a01a216c647e3badc5b1dd23c9b14'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.341155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419a01a216c647e3badc5b1dd23c9b14'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.347751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419a01a216c647e3badc5b1dd23c9b14'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.348490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419a01a216c647e3badc5b1dd23c9b14'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.356486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b8c0e88a-1371-4faf-9f44-c0ad4cfca142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419a01a216c647e3badc5b1dd23c9b14'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:43.362534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1242/2489] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:43 2022] DELETE /identity/v3/users/419a01a216c647e3badc5b1dd23c9b14 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:43.994650 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:43.996128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.009678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b8dd-512f-4962-84c8-6134efa1c741 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.074884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.076141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.076779 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.077123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] PATH_INFO: `/v3/projects/bcfa139291d2467aa92b83ed6630cebb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.078616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfa139291d2467aa92b83ed6630cebb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.080893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.129910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfa139291d2467aa92b83ed6630cebb', 'request_id': 'req-f6196479-b355-4b4e-b104-6cfd5bccb84a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:44.135440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfa139291d2467aa92b83ed6630cebb', 'request_id': 'req-f6196479-b355-4b4e-b104-6cfd5bccb84a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:44.143850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfa139291d2467aa92b83ed6630cebb', 'request_id': 'req-f6196479-b355-4b4e-b104-6cfd5bccb84a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:44.155334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] The token cache is being invalidate because project bcfa139291d2467aa92b83ed6630cebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:44.155618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:44.156254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6196479-b355-4b4e-b104-6cfd5bccb84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:44.158070 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1248/2490] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:43 2022] DELETE /identity/v3/projects/bcfa139291d2467aa92b83ed6630cebb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:44.162779 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.163246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.163347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.183068 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:44.184277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.259644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1243/2491] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:44.262007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.262296 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.262623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.281825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:44.283036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.295132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1249/2492] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:44.296249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.307977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa49ba6-ad08-4496-ab5c-06baab412772 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.313099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.313789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.314074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.314346 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.315633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:42:44.315633 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.317055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.333045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1244/2493] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:42:44.337749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.347500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28dfce-065f-49c4-acda-256390c9eabc None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.352172 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.352892 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.353177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.353453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.354163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.356100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.383509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1250/2494] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:44.387924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.399135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9cbc-905c-4c2d-9248-7567dec0a41e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.459941 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.460662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.460942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.461213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.461929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.463877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.487059 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1245/2495] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:44.491146 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.502018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac1bcc-2f3b-44e4-a65f-ec65b5bad841 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.506885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.507699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.507981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.508257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.509030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.510660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.522733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1251/2496] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:44.526983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.538171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db0654-500c-4061-90e2-5d4859c19a24 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.544009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.544737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.545077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.545393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.546126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.547871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9062f-5128-40ad-a340-78a05ff7d581 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.559482 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1246/2497] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:42:44.563891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.574316 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180edd49-3e54-467d-b138-3c006eb364dc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.579632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.580576 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.580857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.581131 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] PATH_INFO: `/v3/projects/16287e47228a428896433650b11f3029/users/adf0548573bd47dfa28efa136d1be359/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.601009 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16287e47228a428896433650b11f3029, user_id=adf0548573bd47dfa28efa136d1be359, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.604728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.622849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1252/2498] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:44 2022] PUT /identity/v3/projects/16287e47228a428896433650b11f3029/users/adf0548573bd47dfa28efa136d1be359/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:44.627912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861979-8f89-4255-b98c-544c1eca37a3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.628300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861979-8f89-4255-b98c-544c1eca37a3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.628619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861979-8f89-4255-b98c-544c1eca37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.651464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f5861979-8f89-4255-b98c-544c1eca37a3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:44.652754 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f5861979-8f89-4255-b98c-544c1eca37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.723000 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1247/2499] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:44.737057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:44.739176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.807106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fc10d-9474-4292-aebe-344847a31a1d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:44.810935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:44.811624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.811904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.812180 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.821573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:44.823197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:44.834551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1253/2500] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:44.912602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf834b6-f76d-484c-a7cb-41e16998e2d9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:44.913122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf834b6-f76d-484c-a7cb-41e16998e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:44.913553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf834b6-f76d-484c-a7cb-41e16998e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:44.932495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-abf834b6-f76d-484c-a7cb-41e16998e2d9 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:44.933713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-abf834b6-f76d-484c-a7cb-41e16998e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:44.995480 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1248/2501] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:45.009551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:45.011046 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:45.114491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c59980-4fb2-40d6-9700-8ec34eb089d8 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:45.119732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:45.120622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:45.120902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:45.121178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:45.131374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:45.132729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:45.142935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1254/2502] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:42:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:42:46.102964 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.103772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.103772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.142057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] MFA Rules not processed for user `adf0548573bd47dfa28efa136d1be359`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:46.144894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:46.230534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1249/2503] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:46.235760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.258268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea2f6-6bb9-4716-9cff-30bdd607e085 service swift] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.275292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.276801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.278356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.278918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.280796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.287471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.346517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1255/2504] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:46 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:46.350954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.368263 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8642a6-05b1-4887-be70-9f43b86abb0a None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.499627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.500666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.501041 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.501470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.502351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.505492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.548071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1250/2505] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:46 2022] POST /identity/v3/users => generated 308 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:46.552570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.566691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683b8c-77c6-4b95-9e9c-bab1d07743a4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.579778 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.580995 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.581373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.581796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.582780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.586107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.603699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1256/2506] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:46.607799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.622280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d5d2-4aaf-48eb-ad43-2546dc08b78b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.630004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.630925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.631224 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.631486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] PATH_INFO: `/v3/projects/c58a41bb92fb48239965c18fa006196a/users/c92a0cc84ca946d997d91e38731f1268/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.683640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58a41bb92fb48239965c18fa006196a, user_id=c92a0cc84ca946d997d91e38731f1268, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.686476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.723112 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1251/2507] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:46 2022] PUT /identity/v3/projects/c58a41bb92fb48239965c18fa006196a/users/c92a0cc84ca946d997d91e38731f1268/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:46.724198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.742814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b9775-8176-4a94-ae8b-b81289a2f899 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.832352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.833439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.834019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.834760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.835882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.838431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4530f1-89f5-4999-8e96-69aa05bdb989 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.860078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1257/2508] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:42:46.863844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:46.874794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab251-3532-4f15-a817-ca21fd5ea885 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:46.879680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:46.880660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:46.880961 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:46.881217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] PATH_INFO: `/v3/projects/c58a41bb92fb48239965c18fa006196a/users/c92a0cc84ca946d997d91e38731f1268/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:46.883197 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58a41bb92fb48239965c18fa006196a, user_id=c92a0cc84ca946d997d91e38731f1268, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:46.885972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:46.896937 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1252/2509] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:46 2022] PUT /identity/v3/projects/c58a41bb92fb48239965c18fa006196a/users/c92a0cc84ca946d997d91e38731f1268/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:47.676572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641479-eee7-4428-b50b-909159bf2978 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:47.677785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641479-eee7-4428-b50b-909159bf2978 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:47.678256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641479-eee7-4428-b50b-909159bf2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:47.710062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-14641479-eee7-4428-b50b-909159bf2978 None None] MFA Rules not processed for user `c92a0cc84ca946d997d91e38731f1268`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:47.711534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-14641479-eee7-4428-b50b-909159bf2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:47.833104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1258/2510] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:49.235689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:49.337652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876217a5-af6f-4c9a-9ff2-794b04fe8099 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:49.342721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:49.343527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:49.343821 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:49.344125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] PATH_INFO: `/v3/users/adf0548573bd47dfa28efa136d1be359` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:49.345350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf0548573bd47dfa28efa136d1be359)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:49.347686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:49.404839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf0548573bd47dfa28efa136d1be359'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.418427 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf0548573bd47dfa28efa136d1be359'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.436090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf0548573bd47dfa28efa136d1be359'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.437011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf0548573bd47dfa28efa136d1be359'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.445974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf0548573bd47dfa28efa136d1be359'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.452943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1253/2511] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:49 2022] DELETE /identity/v3/users/adf0548573bd47dfa28efa136d1be359 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:49.641740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641479-eee7-4428-b50b-909159bf2978 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:49.665786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641479-eee7-4428-b50b-909159bf2978 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:49.752301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:49.753709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:49.754366 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:49.754853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] PATH_INFO: `/v3/projects/16287e47228a428896433650b11f3029` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:49.756354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16287e47228a428896433650b11f3029)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:49.759008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:49.825715 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16287e47228a428896433650b11f3029', 'request_id': 'req-fc147025-1f5f-467b-a34b-cf78c3454f51'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.839520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16287e47228a428896433650b11f3029', 'request_id': 'req-fc147025-1f5f-467b-a34b-cf78c3454f51'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.848681 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16287e47228a428896433650b11f3029', 'request_id': 'req-fc147025-1f5f-467b-a34b-cf78c3454f51'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.861527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] The token cache is being invalidate because project 16287e47228a428896433650b11f3029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:49.861812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.862641 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:49.864225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1259/2512] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:49 2022] DELETE /identity/v3/projects/16287e47228a428896433650b11f3029 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:49.868246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:49.869876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:49.884019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ad705-f643-4c8a-81ab-c4c57562e268 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:49.945132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:49.946053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:49.946332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:49.946603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] PATH_INFO: `/v3/users/c92a0cc84ca946d997d91e38731f1268` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:49.947780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92a0cc84ca946d997d91e38731f1268)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:49.949734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:49.999500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92a0cc84ca946d997d91e38731f1268'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.010914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92a0cc84ca946d997d91e38731f1268'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.017676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92a0cc84ca946d997d91e38731f1268'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.018402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92a0cc84ca946d997d91e38731f1268'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.026859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-84030a57-827d-44ef-af96-f21da23a7f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92a0cc84ca946d997d91e38731f1268'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.032787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1254/2513] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:49 2022] DELETE /identity/v3/users/c92a0cc84ca946d997d91e38731f1268 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:50.214627 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.216095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:50.230420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc147025-1f5f-467b-a34b-cf78c3454f51 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.339176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.340079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.340422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.340726 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] PATH_INFO: `/v3/projects/c58a41bb92fb48239965c18fa006196a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.342238 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58a41bb92fb48239965c18fa006196a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.344181 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.397260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58a41bb92fb48239965c18fa006196a', 'request_id': 'req-b5475ccc-8421-4e31-9a84-38fd540d57fa'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.407413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58a41bb92fb48239965c18fa006196a', 'request_id': 'req-b5475ccc-8421-4e31-9a84-38fd540d57fa'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.420947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58a41bb92fb48239965c18fa006196a', 'request_id': 'req-b5475ccc-8421-4e31-9a84-38fd540d57fa'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.436740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] The token cache is being invalidate because project c58a41bb92fb48239965c18fa006196a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:50.436740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.437346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b5475ccc-8421-4e31-9a84-38fd540d57fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:50.442842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1260/2514] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:50 2022] DELETE /identity/v3/projects/c58a41bb92fb48239965c18fa006196a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:50.444547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.444917 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.445076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.493129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:50.494490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:50.583803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1255/2515] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:50.591686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.591976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.592343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.612835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:50.616083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:50.623136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1261/2516] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:50.627620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.661226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754715b6-0c13-47e3-84c0-0fe3dbac38bf None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.665971 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.666645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.666931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.667210 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.667944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:42:50.668252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.669960 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.682459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1256/2517] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:42:50.687464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.697124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa90862-bdc8-4a82-bb20-933c62e1a7af None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.701981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.702756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.703104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.703450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.704234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.706275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.739063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1262/2518] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:50 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:42:50.740362 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.750789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36074-7ba7-497e-aad2-ebece870bdbc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.811891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.812639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.812926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.813208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.813904 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.815882 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.839330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1257/2519] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:50 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:50.843690 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.854216 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b2ba-f473-443d-bb25-47b96fa975eb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.859011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.859683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.859986 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.860261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.861036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.862671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.873686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1263/2520] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:50.877889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.890247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c186-111f-422f-96d0-c92f34f7d5e7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.895309 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.896061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.896413 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.896785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.897587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.899264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514643fd-4dab-4ee0-9d0f-0b2eb8bf74cd admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.917508 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1258/2521] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:50.921614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:50.935782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b40f-9758-4887-8a17-d6d7447a887c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:50.940729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:50.941647 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:50.941931 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:50.942211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] PATH_INFO: `/v3/projects/fa354c70dd454c30b9c3a88e47b395e7/users/7010b9e63c5a4fe4908e3f10695ac2cb/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:50.957193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa354c70dd454c30b9c3a88e47b395e7, user_id=7010b9e63c5a4fe4908e3f10695ac2cb, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:50.968422 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:50.990747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1264/2522] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:50 2022] PUT /identity/v3/projects/fa354c70dd454c30b9c3a88e47b395e7/users/7010b9e63c5a4fe4908e3f10695ac2cb/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:51.002412 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.002703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.002980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.040911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] MFA Rules not processed for user `7010b9e63c5a4fe4908e3f10695ac2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:51.042152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:51.112070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1259/2523] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:51.116711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.183413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01d78-fe6c-402e-88b5-2c21b2607601 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.188312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.189033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.189311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.189607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.190631 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.192614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.222884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1265/2524] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:51 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:51.226957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.237456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d9b1-0f29-40f2-be75-4d3cd03995fc None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.293851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.294575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.294858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.295131 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.295862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.298032 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.318702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1260/2525] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:51 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:51.322574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.332983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809579c-bae8-4e6c-a2f8-bb4ea11b44b2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.337725 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.338374 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.338685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.338962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.339694 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.341424 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.352626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1266/2526] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:51.357347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.368987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67295894-6fbf-449d-9758-3a8e21002e7f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.374731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.375666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.376054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.376332 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] PATH_INFO: `/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0/users/d59a4192564a4bf7bf943344e3c6ec7f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.392897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe0b133f9ae42bfa9b8b61bc9a3f7a0, user_id=d59a4192564a4bf7bf943344e3c6ec7f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.395572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.408950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1261/2527] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:51 2022] PUT /identity/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0/users/d59a4192564a4bf7bf943344e3c6ec7f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:51.413454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.424430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22f99-1b67-4f08-b271-4ee43c1c49c4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.481829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.482579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.482933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.483215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.483966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.485909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37770e-8913-4495-8483-54163fd3dcd9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.497206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1267/2528] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:51.501653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.515072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d26a8-9a07-4ba8-a3a1-48307c052ecf admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.527733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.528674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.528958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.529287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] PATH_INFO: `/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0/users/d59a4192564a4bf7bf943344e3c6ec7f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.537180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe0b133f9ae42bfa9b8b61bc9a3f7a0, user_id=d59a4192564a4bf7bf943344e3c6ec7f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.539929 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.551050 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1262/2529] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:51 2022] PUT /identity/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0/users/d59a4192564a4bf7bf943344e3c6ec7f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:51.561978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.562959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.563478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.611442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] MFA Rules not processed for user `d59a4192564a4bf7bf943344e3c6ec7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:51.612867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:51.714594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1268/2530] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:51.736122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:51.737848 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:51.821464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258701-7784-4b3b-8acb-d3add647e821 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:51.825316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:51.826009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:51.826287 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:51.826644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:51.835983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:51.837474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1cb7-6787-49c5-952c-71a2d93573c9 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:51.850777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1263/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:52.478706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:52.548164 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce92be7-45db-4351-87a6-06e52efe8ac5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:52.552573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:52.553583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:52.553886 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:52.554171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] PATH_INFO: `/v3/users/7010b9e63c5a4fe4908e3f10695ac2cb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:52.555378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7010b9e63c5a4fe4908e3f10695ac2cb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:52.557939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:52.609546 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7010b9e63c5a4fe4908e3f10695ac2cb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:52.610224 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7010b9e63c5a4fe4908e3f10695ac2cb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:52.622143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7010b9e63c5a4fe4908e3f10695ac2cb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:52.629965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7010b9e63c5a4fe4908e3f10695ac2cb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:52.661420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7010b9e63c5a4fe4908e3f10695ac2cb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:52.669591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1269/2532] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:52 2022] DELETE /identity/v3/users/7010b9e63c5a4fe4908e3f10695ac2cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:52.674348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:52.674825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:52.674930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:52.693935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:52.695151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:52.790080 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1264/2533] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:42:52.800705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:52.802222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:52.867876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7e62-718c-4602-98fc-b02b2fae206a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:52.875977 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:52.878306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:52.878819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:52.879263 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:52.906393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:52.907875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:52.918837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1270/2534] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:53.233513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:53.240099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:53.252701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f85a-8d08-4ba2-9c6c-a696cb080dcd None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:53.261871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:53.262867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:53.263061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:53.263316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] PATH_INFO: `/v3/projects/fa354c70dd454c30b9c3a88e47b395e7` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:53.265022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa354c70dd454c30b9c3a88e47b395e7)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:53.267196 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:53.335109 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa354c70dd454c30b9c3a88e47b395e7', 'request_id': 'req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.344689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa354c70dd454c30b9c3a88e47b395e7', 'request_id': 'req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.352955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa354c70dd454c30b9c3a88e47b395e7', 'request_id': 'req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.363868 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] The token cache is being invalidate because project fa354c70dd454c30b9c3a88e47b395e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:53.364147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.364785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.366452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1265/2535] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:53 2022] DELETE /identity/v3/projects/fa354c70dd454c30b9c3a88e47b395e7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:53.370553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:53.385281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff351f6-c5b5-4107-8b40-a8029322d227 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:53.443912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:53.444719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:53.445341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:53.445341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] PATH_INFO: `/v3/users/d59a4192564a4bf7bf943344e3c6ec7f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:53.446453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59a4192564a4bf7bf943344e3c6ec7f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:53.448416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:53.496107 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59a4192564a4bf7bf943344e3c6ec7f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.496796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59a4192564a4bf7bf943344e3c6ec7f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.508302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59a4192564a4bf7bf943344e3c6ec7f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.514851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59a4192564a4bf7bf943344e3c6ec7f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.522475 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bc4252c0-4e30-4dd2-b479-5eb582b49e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59a4192564a4bf7bf943344e3c6ec7f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.528368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1271/2536] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:53 2022] DELETE /identity/v3/users/d59a4192564a4bf7bf943344e3c6ec7f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:53.804994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:53.806901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:53.820610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da9ab-7b8b-4773-a6cd-69f3e7ec561f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:53.875627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:53.876525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:53.876810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:53.877083 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] PATH_INFO: `/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:53.878298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe0b133f9ae42bfa9b8b61bc9a3f7a0)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:53.880280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:53.941386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe0b133f9ae42bfa9b8b61bc9a3f7a0', 'request_id': 'req-06fd9692-3ab8-4898-8c79-72d7aebd9309'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.947739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe0b133f9ae42bfa9b8b61bc9a3f7a0', 'request_id': 'req-06fd9692-3ab8-4898-8c79-72d7aebd9309'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.957349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe0b133f9ae42bfa9b8b61bc9a3f7a0', 'request_id': 'req-06fd9692-3ab8-4898-8c79-72d7aebd9309'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.969438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] The token cache is being invalidate because project 0fe0b133f9ae42bfa9b8b61bc9a3f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:53.969767 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.970399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-06fd9692-3ab8-4898-8c79-72d7aebd9309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:53.972123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1266/2537] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:53 2022] DELETE /identity/v3/projects/0fe0b133f9ae42bfa9b8b61bc9a3f7a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:53.977278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:53.977783 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:53.977907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:53.997126 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:53.998337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.056484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1272/2538] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:54.064645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.064935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.065213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.085860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:54.087592 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.097916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1267/2539] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:54.101814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.111349 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87736bd1-df28-46b5-aa89-f28cb53dd301 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.116108 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.116875 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.117163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.117443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.121193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:42:54.121516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.123264 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.136011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1273/2540] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:42:54.140367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.149736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305238c6-4627-4488-9c56-e39c02f1a9d5 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.154423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.155104 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.155390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.155663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.156359 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.158300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.188505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1268/2541] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:54 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:54.190138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.200279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2adca0-9d1d-4682-b5eb-ffbcf759c773 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.261311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.261990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.262276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.262559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.263257 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.265246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.287048 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1274/2542] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:54 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:42:54.292591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.302816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380683-f4c3-4d39-8729-81d60e583920 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.308149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.308853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.309144 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.309411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.310139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.311843 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.322055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1269/2543] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:54.326056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.336079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032e298-1ab0-4921-860f-826973df8e8b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.341013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.341680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.341963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.342246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.343060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.344697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b68f1b-fae9-45e9-8349-ffa6228be1d4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.354421 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1275/2544] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:54.358459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.368541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e9a9-0a70-4485-a3d1-7f77832538ce admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.373577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.374699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.374978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.375239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] PATH_INFO: `/v3/projects/942a2de7f33a43ea8740c73fd32fa41e/users/a092a3a9d1f74a03827ac9032ccbd8ed/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.390572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942a2de7f33a43ea8740c73fd32fa41e, user_id=a092a3a9d1f74a03827ac9032ccbd8ed, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.392794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.409460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1270/2545] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:54 2022] PUT /identity/v3/projects/942a2de7f33a43ea8740c73fd32fa41e/users/a092a3a9d1f74a03827ac9032ccbd8ed/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:42:54.420763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.421213 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.421318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.449359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] MFA Rules not processed for user `a092a3a9d1f74a03827ac9032ccbd8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:54.450587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.517217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1276/2546] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:54.547867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.549818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.607258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da891-5251-44d4-be70-2495ec0dccd4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.611342 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.611989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.612268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.612569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.620920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.622353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c02f42-8c17-4169-b9b1-d90ec42fe076 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.631116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1271/2547] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:54.645449 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.707762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9759-0d1c-41cf-b476-b961d5197bf1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.713360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.714228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.714509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.714785 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] PATH_INFO: `/v3/users/a092a3a9d1f74a03827ac9032ccbd8ed` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.716037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a092a3a9d1f74a03827ac9032ccbd8ed)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.718121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.770801 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a092a3a9d1f74a03827ac9032ccbd8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:54.771485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a092a3a9d1f74a03827ac9032ccbd8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:54.782936 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a092a3a9d1f74a03827ac9032ccbd8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:54.789671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a092a3a9d1f74a03827ac9032ccbd8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:54.797389 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a092a3a9d1f74a03827ac9032ccbd8ed'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:54.803173 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1277/2548] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:42:54 2022] DELETE /identity/v3/users/a092a3a9d1f74a03827ac9032ccbd8ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:54.808243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.808751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.808856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.826640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:54.827931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.885335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1272/2549] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:54.896283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:54.897738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:54.963209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d52cd-99a3-4572-9aac-64061faad96f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:54.967223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:54.968020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:54.968295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:54.968583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:54.978487 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:54.979928 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14974985-2afc-4c14-a4b4-6420d96edfd7 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:54.990248 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1278/2550] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:42:55.292190 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.293746 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:55.308877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9808a-86dc-4902-836d-84a6b53ea283 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.313999 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.314877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.315160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.315437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] PATH_INFO: `/v3/projects/942a2de7f33a43ea8740c73fd32fa41e` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.316679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942a2de7f33a43ea8740c73fd32fa41e)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.318614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.374350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942a2de7f33a43ea8740c73fd32fa41e', 'request_id': 'req-d2140076-6c81-48df-b10e-235b0c2b8d09'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:55.381699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942a2de7f33a43ea8740c73fd32fa41e', 'request_id': 'req-d2140076-6c81-48df-b10e-235b0c2b8d09'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:55.396627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942a2de7f33a43ea8740c73fd32fa41e', 'request_id': 'req-d2140076-6c81-48df-b10e-235b0c2b8d09'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:55.408611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] The token cache is being invalidate because project 942a2de7f33a43ea8740c73fd32fa41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:42:55.408899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:55.409541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d2140076-6c81-48df-b10e-235b0c2b8d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:42:55.411120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1273/2551] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:42:55 2022] DELETE /identity/v3/projects/942a2de7f33a43ea8740c73fd32fa41e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:55.416065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.416350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.416662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.437286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:55.438492 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:55.495901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1279/2552] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:55.503948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.504241 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.504553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.527171 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:55.528388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:55.537956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1274/2553] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:55.542246 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.552340 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bb301-759e-4438-b360-5db356bbf5da None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.558570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.559419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.559698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.559969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.560727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:42:55.561029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.562676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.577176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1280/2554] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:42:55.581612 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.591142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7372-42b5-4fd6-a6b3-cb5ecf2c6a78 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.596842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.597506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.597792 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.598061 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.598751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.600679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.628220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1275/2555] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:42:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:55.632988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.643850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4a842-d670-44f5-ae22-6d6187a42647 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.705243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.705924 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.706206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.706479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.707174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.709189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.734663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1281/2556] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:42:55 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:42:55.739421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.750084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412facbb-c6ef-4ccf-87f5-0f060ed9adaf admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.755140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.755817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.756119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.756394 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.757139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.758805 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.769355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1276/2557] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:55.773226 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.783095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0809031-60e5-4d75-959c-aa8c1c873149 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.787843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.788568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.788851 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.789123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.789850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.791439 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ce97-b524-4f49-b0d2-6730d1b57ad1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.801447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1282/2558] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:42:55.805460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.816798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f332-4986-4f79-bfcd-df2978bbcb50 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:55.822322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:55.823227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.823512 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.823778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] PATH_INFO: `/v3/projects/45baf1aeccab4b4fa78819bdb00078d6/users/8e052de47d3d496485c002475cce249b/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.840545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45baf1aeccab4b4fa78819bdb00078d6, user_id=8e052de47d3d496485c002475cce249b, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:55.843293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:55.858498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1277/2559] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:42:55 2022] PUT /identity/v3/projects/45baf1aeccab4b4fa78819bdb00078d6/users/8e052de47d3d496485c002475cce249b/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:42:55.868891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e753-69c6-402f-a136-931d1d5b3670 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:55.869176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e753-69c6-402f-a136-931d1d5b3670 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:55.869457 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e753-69c6-402f-a136-931d1d5b3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:55.896057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bd25e753-69c6-402f-a136-931d1d5b3670 None None] MFA Rules not processed for user `8e052de47d3d496485c002475cce249b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:42:55.897471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bd25e753-69c6-402f-a136-931d1d5b3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:55.960235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1283/2560] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:42:55.971276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:42:55.973072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:42:56.036045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e738c-2fef-4892-962a-68ff423f6030 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:42:56.040619 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:42:56.041275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:42:56.041562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:42:56.041965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:42:56.051370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:42:56.052875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:42:56.064114 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1278/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:42:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:02.103842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:02.104314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:02.104411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:02.123102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:02.124332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:02.178427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1284/2562] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:43:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:02.191909 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:02.193567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:02.262162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c677-918f-4f3e-9382-988ee8981ace service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:02.268067 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:02.268755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:02.269036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:02.269310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:02.278416 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:02.280024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:02.288392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1279/2563] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:43:02.759008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:02.760577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:02.815611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55c0e-9a39-4214-b28d-b5307e0f7e5b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:02.819063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:02.819711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:02.819990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:02.820256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:02.822209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:02.888406 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:02.890063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29016a9-31cb-439d-82f2-0a579a85874d service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:02.899523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1285/2564] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:05.989762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.007137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f58d1-4c71-4d30-b911-1b36a4edd474 service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.017107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.026199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.026903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.029156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] PATH_INFO: `/v3/users/8e052de47d3d496485c002475cce249b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.030873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e052de47d3d496485c002475cce249b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.038302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.099959 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e052de47d3d496485c002475cce249b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.114474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e052de47d3d496485c002475cce249b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.136861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e052de47d3d496485c002475cce249b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.137489 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e052de47d3d496485c002475cce249b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.146726 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e052de47d3d496485c002475cce249b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.153158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1280/2565] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:05 2022] DELETE /identity/v3/users/8e052de47d3d496485c002475cce249b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:06.157904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.158766 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.159211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.179688 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:06.184050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.253020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1286/2566] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:06.260193 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.261823 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.266437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.267807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.277375 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6c94-36ae-4a25-805c-413ee5c13b55 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.282536 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.283456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.283737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.284011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] PATH_INFO: `/v3/users/b578680e88c741bda2c8e56b2dc9d335` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.285302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b578680e88c741bda2c8e56b2dc9d335)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.287222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.325436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5222-7449-47a6-95b7-823b0dcec498 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.329142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.329796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.330096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.330353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.339947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b578680e88c741bda2c8e56b2dc9d335'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.344209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.345921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.353311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b578680e88c741bda2c8e56b2dc9d335'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.356656 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1287/2567] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:06.360240 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b578680e88c741bda2c8e56b2dc9d335'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.361008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b578680e88c741bda2c8e56b2dc9d335'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.368983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b578680e88c741bda2c8e56b2dc9d335'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.375127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1281/2568] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:06 2022] DELETE /identity/v3/users/b578680e88c741bda2c8e56b2dc9d335 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:06.581076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.594469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443e6bf-9983-4e87-9ff7-1e44e4ee359f service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.663270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.664476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.676028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.676934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.676934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.677179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] PATH_INFO: `/v3/projects/2beaab3a72a345d98a9ec4e0ae4686b6` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.678356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2beaab3a72a345d98a9ec4e0ae4686b6)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.680707 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.740965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b90a-d901-41c0-b58b-48c554cbb895 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.749755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2beaab3a72a345d98a9ec4e0ae4686b6', 'request_id': 'req-01b00471-92a8-4781-8510-b73683c4a378'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.760781 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2beaab3a72a345d98a9ec4e0ae4686b6', 'request_id': 'req-01b00471-92a8-4781-8510-b73683c4a378'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.769700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2beaab3a72a345d98a9ec4e0ae4686b6', 'request_id': 'req-01b00471-92a8-4781-8510-b73683c4a378'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.784761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] The token cache is being invalidate because project 2beaab3a72a345d98a9ec4e0ae4686b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:06.785043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.785700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-01b00471-92a8-4781-8510-b73683c4a378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.788701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1288/2569] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:06 2022] DELETE /identity/v3/projects/2beaab3a72a345d98a9ec4e0ae4686b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:06.795292 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb570-6ac0-44df-b91b-2e8b9017b3c7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.795583 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb570-6ac0-44df-b91b-2e8b9017b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.795859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb570-6ac0-44df-b91b-2e8b9017b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.812662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.813584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.813913 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.814238 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] PATH_INFO: `/v3/projects/45baf1aeccab4b4fa78819bdb00078d6` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.815610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45baf1aeccab4b4fa78819bdb00078d6)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.817200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ffdcb570-6ac0-44df-b91b-2e8b9017b3c7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:06.817553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.818429 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ffdcb570-6ac0-44df-b91b-2e8b9017b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.826823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1289/2570] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:06.837706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.838282 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.838596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.857621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:06.858910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.869456 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45baf1aeccab4b4fa78819bdb00078d6', 'request_id': 'req-6d3c1640-bdeb-42d4-b89b-65452fb31533'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.875140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45baf1aeccab4b4fa78819bdb00078d6', 'request_id': 'req-6d3c1640-bdeb-42d4-b89b-65452fb31533'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.884587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45baf1aeccab4b4fa78819bdb00078d6', 'request_id': 'req-6d3c1640-bdeb-42d4-b89b-65452fb31533'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.897798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] The token cache is being invalidate because project 45baf1aeccab4b4fa78819bdb00078d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:06.898218 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.898983 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-6d3c1640-bdeb-42d4-b89b-65452fb31533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:06.904562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1282/2571] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:06 2022] DELETE /identity/v3/projects/45baf1aeccab4b4fa78819bdb00078d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:06.907194 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978440e9-5102-4f0f-a797-354d6b9efe7f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.909146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978440e9-5102-4f0f-a797-354d6b9efe7f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.909797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978440e9-5102-4f0f-a797-354d6b9efe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.930563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1290/2572] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:06.932053 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.934759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-978440e9-5102-4f0f-a797-354d6b9efe7f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:06.936715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-978440e9-5102-4f0f-a797-354d6b9efe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.942676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683bbbc-29c5-4d2f-b6e0-f6321622231e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.946594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1283/2573] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:06.947960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.948691 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.948962 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.949240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.949981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:06.950289 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:06.953974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:06.954822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.955124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.955407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.972907 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:06.974066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.974676 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:06.975938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:06.987375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aac3e3-a915-40bb-a4fd-5c76a2f11037 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:06.988232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1284/2575] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:06.991364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:06.992763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:06.993964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:06.994318 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:06.994666 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:06.996204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.000211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.001254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0f0f-b058-455b-b436-32f824c4efc7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.008791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.010057 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.010461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.011500 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.011624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:07.011962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.014647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.032761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1292/2576] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:06 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:07.035045 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1285/2577] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:43:07.037281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.038466 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.048694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78a29b-f9b9-439e-ba8b-502d51d1d87c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.123162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87650c31-b92c-4327-9347-c06d86a938a5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.125414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.126708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.128027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.128654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.129963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.130646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.130947 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.131206 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.131990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.133165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.134089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.136655 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.156954 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1293/2578] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:07.161228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.172659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50ea9-0fe8-41bc-97c5-ba291e44d4c6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.176653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1286/2579] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:07.179470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.239572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.240259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.240584 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.240866 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.241632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.243279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.249899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd775a1-c5a8-4918-961c-32a5bbb23fba admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.253502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1294/2580] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:07.257722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.257849 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.258486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.258776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.259038 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.259725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.261701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.267570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd44db-9265-4676-a612-7e072d74a03b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.273018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.274671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.275116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.275816 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.277123 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.279534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.283581 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1287/2581] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:07.287410 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.291127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1295/2582] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:07.295079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.297085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a855-5cdd-4bd0-b463-db6be563b9a4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.301713 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.302398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.302670 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.302952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.303686 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.305352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.306239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5dc0f-0f7e-43ad-8874-1103ebb922e8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.311378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.312265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.312582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.312863 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] PATH_INFO: `/v3/projects/3354a8ff850b4f0193dcf1565f7ca6eb/users/ec2497312fb94adc990e380bf2bbf9d8/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.315957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1288/2583] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:07.319927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.329606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb326-6f66-44d0-9eaa-261a2811f5ff admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.330329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3354a8ff850b4f0193dcf1565f7ca6eb, user_id=ec2497312fb94adc990e380bf2bbf9d8, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.333047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.334407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.335063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.335351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.335645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.336356 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.338043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ab765-97a6-44ed-92b9-c0fe7fc06951 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.347166 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1296/2584] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:07 2022] PUT /identity/v3/projects/3354a8ff850b4f0193dcf1565f7ca6eb/users/ec2497312fb94adc990e380bf2bbf9d8/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:07.352462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1289/2585] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:07.354689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.358015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.358302 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.358579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.385253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] MFA Rules not processed for user `ec2497312fb94adc990e380bf2bbf9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:07.386586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:07.418992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a318-0c9d-43c9-a064-5e1ca4952f7c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.424359 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.425415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.425581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.425862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] PATH_INFO: `/v3/projects/6bbb756cc7a349b1a8eae1b170f600aa/users/fdb9cf003d1b4fb7b053ab43739d5b87/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.440525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbb756cc7a349b1a8eae1b170f600aa, user_id=fdb9cf003d1b4fb7b053ab43739d5b87, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.443191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7deee8-5a44-498b-92c1-0678c0894dd9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.450124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1290/2586] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:07.454758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.457930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1297/2587] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:07 2022] PUT /identity/v3/projects/6bbb756cc7a349b1a8eae1b170f600aa/users/fdb9cf003d1b4fb7b053ab43739d5b87/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:07.466084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2172f11-d805-44eb-8ce8-f7f500b148c7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.470732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.471028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.471345 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.497898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] MFA Rules not processed for user `fdb9cf003d1b4fb7b053ab43739d5b87`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:07.499041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:07.519775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.520452 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.520745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.521013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.521692 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.523599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.552024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1291/2588] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:07.553108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.561554 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1298/2589] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:07.572401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.573791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:07.616661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48013f-887e-4b4d-bc2f-d3e2f702b400 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.621308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.621978 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.622271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.622531 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.623212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.625199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.636240 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e086dc-332e-4b11-96f1-c15ae840092d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.651862 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1292/2590] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:07.655733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.667902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d89-76ab-49cc-b1bb-687642fce592 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.674334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.675014 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.675298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.675591 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.676324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.677977 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.689175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1293/2591] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:07.693667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.694403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.695068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.695347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.695606 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.703505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4bd0-9907-4d11-b6a6-6fe1fe9e0f37 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.708226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.709129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.709411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.709685 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] PATH_INFO: `/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69/users/b0402f583aaa460d8b0f58710f56a40f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.724602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b62c7f69f34c4bb3eed32f11b8bb69, user_id=b0402f583aaa460d8b0f58710f56a40f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.727295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.740404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1294/2592] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:07 2022] PUT /identity/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69/users/b0402f583aaa460d8b0f58710f56a40f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:07.744350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.750828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.752225 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.761448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1299/2593] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:43:07.803948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ae70-6a59-4126-9b83-e52ae50c70fb admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.809488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.810154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.810547 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.810822 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.811550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.813264 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f831f0e-548d-4677-802f-e82985bd4931 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.823269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1295/2594] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:07.827748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.838499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8511e-e02c-4c9b-8295-d002d327c1be service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:07.843585 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:07.844564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.844879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.845156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] PATH_INFO: `/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69/users/b0402f583aaa460d8b0f58710f56a40f/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.847194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b62c7f69f34c4bb3eed32f11b8bb69, user_id=b0402f583aaa460d8b0f58710f56a40f, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:07.849926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:07.860156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1300/2595] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:07 2022] PUT /identity/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69/users/b0402f583aaa460d8b0f58710f56a40f/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:07.871606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:07.871894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:07.872169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:07.901140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] MFA Rules not processed for user `b0402f583aaa460d8b0f58710f56a40f`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:07.902700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:07.978105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1296/2596] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:07.994057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:07.995278 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:08.061870 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d210bc-385d-48df-8e6f-d44183b30149 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:08.065653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:08.066306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:08.066592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:08.066872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:08.076626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:08.078493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff13c-7226-4c03-937d-19aaf229b2e6 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:08.089378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1301/2597] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:08.189407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:08.199254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a028492-af9d-45e4-827f-d036ade945f7 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:08.203320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:08.204064 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:08.204415 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:08.204782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:08.263379 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:08.264790 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:08.274148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1297/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:09.174342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871c01-915d-4c2d-9d51-f41b63928ce2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:09.174926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871c01-915d-4c2d-9d51-f41b63928ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:09.174926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871c01-915d-4c2d-9d51-f41b63928ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:09.194468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2b871c01-915d-4c2d-9d51-f41b63928ce2 None None] MFA Rules not processed for user `fdb9cf003d1b4fb7b053ab43739d5b87`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:09.195674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2b871c01-915d-4c2d-9d51-f41b63928ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:09.251105 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1302/2599] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:10.878975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:10.956012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837561bf-d6cd-4e64-99e3-ec70ecef4f9a service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:10.960752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:10.961668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:10.962587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:10.962874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] PATH_INFO: `/v3/users/ec2497312fb94adc990e380bf2bbf9d8` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:10.964077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2497312fb94adc990e380bf2bbf9d8)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:10.966180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:11.024301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2497312fb94adc990e380bf2bbf9d8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.038232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2497312fb94adc990e380bf2bbf9d8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.045486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2497312fb94adc990e380bf2bbf9d8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.046298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2497312fb94adc990e380bf2bbf9d8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.059479 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2497312fb94adc990e380bf2bbf9d8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.074647 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1298/2600] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:10 2022] DELETE /identity/v3/users/ec2497312fb94adc990e380bf2bbf9d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:11.079504 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:11.080430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:11.080916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:11.104495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:11.105803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:11.176256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1303/2601] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:11.188980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:11.191310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:11.253340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e84c-4cbc-4522-a392-40b18cc3107d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:11.258658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:11.259443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:11.259819 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:11.260627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:11.272146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:11.274602 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:11.288471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1299/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:43:11.796918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:11.798988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:11.814548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36416598-c843-45de-9f8b-aaecf9ed7cbc None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:11.821286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:11.822545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:11.823299 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:11.823588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] PATH_INFO: `/v3/projects/3354a8ff850b4f0193dcf1565f7ca6eb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:11.825768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3354a8ff850b4f0193dcf1565f7ca6eb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:11.827393 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:11.885952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3354a8ff850b4f0193dcf1565f7ca6eb', 'request_id': 'req-3b65d54c-d527-48dc-a6c4-f11a04766b8e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.893363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3354a8ff850b4f0193dcf1565f7ca6eb', 'request_id': 'req-3b65d54c-d527-48dc-a6c4-f11a04766b8e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.901872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3354a8ff850b4f0193dcf1565f7ca6eb', 'request_id': 'req-3b65d54c-d527-48dc-a6c4-f11a04766b8e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.916982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] The token cache is being invalidate because project 3354a8ff850b4f0193dcf1565f7ca6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:11.917602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.919143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:11.921300 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1304/2603] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:11 2022] DELETE /identity/v3/projects/3354a8ff850b4f0193dcf1565f7ca6eb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:11.925532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:11.936383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaa250-69bb-4608-bb00-0cdbab1947a9 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:12.002858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:12.003925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.004304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.004708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] PATH_INFO: `/v3/users/b0402f583aaa460d8b0f58710f56a40f` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.006087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0402f583aaa460d8b0f58710f56a40f)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:12.008684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:12.068632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0402f583aaa460d8b0f58710f56a40f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.084588 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0402f583aaa460d8b0f58710f56a40f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.092570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0402f583aaa460d8b0f58710f56a40f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.093490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0402f583aaa460d8b0f58710f56a40f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.103198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9d013af2-0dbd-44de-9f81-06e0eadfc41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0402f583aaa460d8b0f58710f56a40f'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.112303 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1300/2604] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:11 2022] DELETE /identity/v3/users/b0402f583aaa460d8b0f58710f56a40f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:12.420527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:12.423079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:12.449360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65d54c-d527-48dc-a6c4-f11a04766b8e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:12.530291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:12.531274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.531632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.532196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] PATH_INFO: `/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.533567 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b62c7f69f34c4bb3eed32f11b8bb69)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:12.535599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:12.590085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b62c7f69f34c4bb3eed32f11b8bb69', 'request_id': 'req-bfe44476-c2f9-4a64-bbf6-9027200cd001'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.595481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b62c7f69f34c4bb3eed32f11b8bb69', 'request_id': 'req-bfe44476-c2f9-4a64-bbf6-9027200cd001'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.606082 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b62c7f69f34c4bb3eed32f11b8bb69', 'request_id': 'req-bfe44476-c2f9-4a64-bbf6-9027200cd001'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.619142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] The token cache is being invalidate because project f4b62c7f69f34c4bb3eed32f11b8bb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:12.619408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.620136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bfe44476-c2f9-4a64-bbf6-9027200cd001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:12.625882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1305/2605] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:12 2022] DELETE /identity/v3/projects/f4b62c7f69f34c4bb3eed32f11b8bb69 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:12.627262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.627739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.628151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.647107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:12.648345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:12.723756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1301/2606] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:12.731519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.731906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.732807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.753679 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:12.755281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:12.763991 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1306/2607] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:12.768751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:12.778725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7821eb-838f-4be4-81c2-006775d35974 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:12.783483 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:12.784149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.784426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.784731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.785463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:12.785786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:12.787398 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:12.801314 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1302/2608] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:12.805950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:12.815930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea55d9-9f15-42c7-b6ba-0d6ed269447e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:12.821840 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:12.822988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.822988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.823230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.823767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:12.825753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:12.878411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1307/2609] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:12 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:12.882392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:12.895372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242471b-46fd-4143-9c3e-adef48ee1f96 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:12.965149 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:12.965864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:12.966152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:12.966425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:12.967271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:12.969298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:12.995945 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1303/2610] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:12 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:13.000159 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.012407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5e88-bae4-45db-90f1-9248138845be admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.017483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.018879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.018879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.019103 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.019883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.021797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.037153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1308/2611] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:13.040956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.052625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022633-1a60-4f11-9226-ef61241cd356 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.059568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.060409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.060815 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.061273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.062117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.063900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e4e72-e2c2-4db9-b9cb-5e3541d79930 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.080097 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1304/2612] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:13.081328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.092054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dba34-5c8b-4bc6-b853-f2ee02a5b2db admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.099020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.100568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.101012 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.101835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] PATH_INFO: `/v3/projects/e066bfeab4124a2f87aff14d2f33072b/users/54d4682528b94b8bb520d33d19742d2a/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.123910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e066bfeab4124a2f87aff14d2f33072b, user_id=54d4682528b94b8bb520d33d19742d2a, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.127060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.160252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1309/2613] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:13 2022] PUT /identity/v3/projects/e066bfeab4124a2f87aff14d2f33072b/users/54d4682528b94b8bb520d33d19742d2a/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:13.173184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.173951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.174235 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.202434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] MFA Rules not processed for user `54d4682528b94b8bb520d33d19742d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:13.203662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:13.271610 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1305/2614] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:13.276100 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.338519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5213-a485-403e-9602-8c42322b8f2e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.343335 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.343994 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.344271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.344586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.345315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.347209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.373221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1310/2615] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:13 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:13.377401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.388199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c21bf-70ea-47d4-afc5-f0a16481b9b0 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.446253 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.446947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.447234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.447511 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.448603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.450198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.473873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1306/2616] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:13 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:13.475092 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.486035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fc8e2-5ac2-46ec-9f5c-09d0f87c302d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.490963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.491721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.492069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.492346 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.493118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.494767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.505191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1311/2617] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:13.509429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.520176 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927a498-1d15-481e-a527-2144a49bef4a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.525644 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.526572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.526850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.527122 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] PATH_INFO: `/v3/projects/1b29bb9c46e946499f422ba1f12c61db/users/60fa8b2c61bc4023923f288acce8b2d5/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.542957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b29bb9c46e946499f422ba1f12c61db, user_id=60fa8b2c61bc4023923f288acce8b2d5, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.545668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.560321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1307/2618] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:13 2022] PUT /identity/v3/projects/1b29bb9c46e946499f422ba1f12c61db/users/60fa8b2c61bc4023923f288acce8b2d5/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:13.564699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.575331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2727c3-4bf8-4dda-8694-8b86ffcee2a1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.634998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.636051 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.636526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.636959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.637885 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.639542 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cea71-7df3-4a54-966d-8f271d08bfed admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.650099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1312/2619] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:13.654324 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.665116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aec1b-6d8e-482b-81fb-720b532613f2 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.673156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.674066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.674344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.674615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] PATH_INFO: `/v3/projects/1b29bb9c46e946499f422ba1f12c61db/users/60fa8b2c61bc4023923f288acce8b2d5/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.676668 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b29bb9c46e946499f422ba1f12c61db, user_id=60fa8b2c61bc4023923f288acce8b2d5, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.679281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.690056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1308/2620] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:13 2022] PUT /identity/v3/projects/1b29bb9c46e946499f422ba1f12c61db/users/60fa8b2c61bc4023923f288acce8b2d5/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:13.701700 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.701989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.702265 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.736676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] MFA Rules not processed for user `60fa8b2c61bc4023923f288acce8b2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:13.737900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:13.805534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1313/2621] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:13.816962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:13.819053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:13.880319 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c5ab-1a3d-4287-ab0e-6d47a257cc38 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:13.886640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:13.887557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:13.887854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:13.888119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:13.903922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:13.906048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe521-ea5d-4458-9429-8f68b81378d8 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:13.916237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1309/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:14.051230 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:14.113133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ea51d-47bd-4eab-80ec-ef04af48a9ee None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:14.118404 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:14.119256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:14.119538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:14.119814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] PATH_INFO: `/v3/users/54d4682528b94b8bb520d33d19742d2a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:14.121106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d4682528b94b8bb520d33d19742d2a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:14.123040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:14.173881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d4682528b94b8bb520d33d19742d2a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.174538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d4682528b94b8bb520d33d19742d2a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.186351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d4682528b94b8bb520d33d19742d2a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.193189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d4682528b94b8bb520d33d19742d2a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.201948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d4682528b94b8bb520d33d19742d2a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.207893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1314/2623] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:14 2022] DELETE /identity/v3/users/54d4682528b94b8bb520d33d19742d2a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:14.212593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:14.213063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:14.213281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:14.230990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:14.232204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:14.290993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1310/2624] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:14.301701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:14.303124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:14.363365 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a2fe2-5020-41dd-8a07-8bac7a0ed7e3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:14.367668 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:14.368320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:14.368714 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:14.368996 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:14.378376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:14.379819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:14.389465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1315/2625] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:14.657943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:14.659408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:14.682665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e4bd6-20a6-4c86-b51c-01921ad82760 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:14.688212 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:14.689265 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:14.689654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:14.690021 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] PATH_INFO: `/v3/projects/e066bfeab4124a2f87aff14d2f33072b` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:14.691388 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e066bfeab4124a2f87aff14d2f33072b)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:14.693513 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:14.739741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e066bfeab4124a2f87aff14d2f33072b', 'request_id': 'req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.747905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e066bfeab4124a2f87aff14d2f33072b', 'request_id': 'req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.757736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e066bfeab4124a2f87aff14d2f33072b', 'request_id': 'req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.770529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] The token cache is being invalidate because project e066bfeab4124a2f87aff14d2f33072b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:14.770957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.771697 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.773672 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1311/2626] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:14 2022] DELETE /identity/v3/projects/e066bfeab4124a2f87aff14d2f33072b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:14.784427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:14.796882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e68f-c915-4949-83d1-57cfab68a0e6 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:14.855825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072eba24-7259-409f-b609-708320828aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:14.856643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eba24-7259-409f-b609-708320828aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:14.856921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eba24-7259-409f-b609-708320828aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:14.857188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eba24-7259-409f-b609-708320828aca admin admin] PATH_INFO: `/v3/users/60fa8b2c61bc4023923f288acce8b2d5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:14.858485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072eba24-7259-409f-b609-708320828aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fa8b2c61bc4023923f288acce8b2d5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:14.860573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072eba24-7259-409f-b609-708320828aca admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:14.907596 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-072eba24-7259-409f-b609-708320828aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fa8b2c61bc4023923f288acce8b2d5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.908268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-072eba24-7259-409f-b609-708320828aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fa8b2c61bc4023923f288acce8b2d5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.921183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-072eba24-7259-409f-b609-708320828aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fa8b2c61bc4023923f288acce8b2d5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.928677 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-072eba24-7259-409f-b609-708320828aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fa8b2c61bc4023923f288acce8b2d5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.937989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-072eba24-7259-409f-b609-708320828aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fa8b2c61bc4023923f288acce8b2d5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:14.943939 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1316/2627] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:14 2022] DELETE /identity/v3/users/60fa8b2c61bc4023923f288acce8b2d5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:15.215558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.217161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:15.235471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27a0f-4f98-4e25-b9a3-0054b60f7c4a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.292349 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.293272 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.293545 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.293817 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] PATH_INFO: `/v3/projects/1b29bb9c46e946499f422ba1f12c61db` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.295105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b29bb9c46e946499f422ba1f12c61db)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.297025 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.346597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b29bb9c46e946499f422ba1f12c61db', 'request_id': 'req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:15.352279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b29bb9c46e946499f422ba1f12c61db', 'request_id': 'req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:15.360879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b29bb9c46e946499f422ba1f12c61db', 'request_id': 'req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:15.371875 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] The token cache is being invalidate because project 1b29bb9c46e946499f422ba1f12c61db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:15.372160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:15.372824 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-70375d90-6f04-4de5-a7a6-1547cdc1bbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:15.374384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1312/2628] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:15 2022] DELETE /identity/v3/projects/1b29bb9c46e946499f422ba1f12c61db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:15.379582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.379847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.380148 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.400425 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:15.401692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:15.469864 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1317/2629] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:15.475208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.475572 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.475853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.495004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:15.496207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:15.505137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1313/2630] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:15.509572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.519559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e363-e4fe-4018-b55e-fc41e50d7b86 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.524657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.525303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.525621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.525884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.526610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:15.526913 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.528503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.540049 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1318/2631] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:15.544417 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.554042 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceabee-353d-431b-ae2a-41ac30e06207 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.560393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.561074 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.561353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.561623 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.562307 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.564191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.593866 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1314/2632] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:15.600187 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.613992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833bb4-bdb8-47dc-a818-6e10cef5c494 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.670453 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.671132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.671405 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.671664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.672378 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.674383 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.698069 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1319/2633] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:15 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:15.702421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.712846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6515-2f34-4da8-b853-e9b0b3bd0af7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.717678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.718340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.718620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.718899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.719653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.721294 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.731425 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1315/2634] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:15.735568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.755464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a0316-0e40-42aa-a780-154a3a38155f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.762945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.763880 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.764251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.764639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.765737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.767712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f47a4-a189-486c-84f4-6d48eeee5e75 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.777857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1320/2635] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:15.784401 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.800044 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07cca-fcb5-4bb4-a78f-5be2310e3def admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:15.805430 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:15.806334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.806615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.807257 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] PATH_INFO: `/v3/projects/3d175ce9f69849ffadc66acf753e0e73/users/c1646bd9c55b4820884b09b2e39f77f5/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.824661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d175ce9f69849ffadc66acf753e0e73, user_id=c1646bd9c55b4820884b09b2e39f77f5, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:15.827316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:15.847198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1316/2636] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:15 2022] PUT /identity/v3/projects/3d175ce9f69849ffadc66acf753e0e73/users/c1646bd9c55b4820884b09b2e39f77f5/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:15.857854 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:15.858352 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:15.858478 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:15.885158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] MFA Rules not processed for user `c1646bd9c55b4820884b09b2e39f77f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:15.886362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:15.956041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1321/2637] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:15.967720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:15.969474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.023657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bcbd7-0cc9-4fc9-a8c0-25f5d9a709bc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.027601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.028234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.028549 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.028826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.037382 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.038825 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2155e-ea29-4730-9118-0be70db00e4e service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:16.047836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1317/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:16.067452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:16.128111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61ad6d-9405-42bb-a206-e7afa02b1059 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.134436 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.135430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.135721 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.136003 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] PATH_INFO: `/v3/users/c1646bd9c55b4820884b09b2e39f77f5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.137243 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1646bd9c55b4820884b09b2e39f77f5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.139191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:16.188848 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1646bd9c55b4820884b09b2e39f77f5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.189654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1646bd9c55b4820884b09b2e39f77f5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.201491 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1646bd9c55b4820884b09b2e39f77f5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.208414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1646bd9c55b4820884b09b2e39f77f5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.217855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1646bd9c55b4820884b09b2e39f77f5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.224055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1322/2639] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:16 2022] DELETE /identity/v3/users/c1646bd9c55b4820884b09b2e39f77f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:16.228867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.229361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.229460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.247285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:16.248503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.321161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1318/2640] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:16.332839 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:16.334672 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.397531 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0088b4-1c1d-4454-9624-6ab597539cd8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.402153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.402812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.403094 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.403375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.412997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.414430 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5520-b8ee-4fef-963c-0ac9c2e37d48 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:16.424099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1323/2641] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:16.686206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:16.687803 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.701442 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b0d3-a78a-4f67-b88a-1d148d734ad3 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.707281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.708279 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.708605 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.708883 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] PATH_INFO: `/v3/projects/3d175ce9f69849ffadc66acf753e0e73` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.710192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d175ce9f69849ffadc66acf753e0e73)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.712354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:16.762583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d175ce9f69849ffadc66acf753e0e73', 'request_id': 'req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.767956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d175ce9f69849ffadc66acf753e0e73', 'request_id': 'req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.776552 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d175ce9f69849ffadc66acf753e0e73', 'request_id': 'req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.787666 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] The token cache is being invalidate because project 3d175ce9f69849ffadc66acf753e0e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:16.787949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.788659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-4b53dd68-e5c3-48b2-8a4c-97ab94ed0793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:16.790290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1319/2642] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:16 2022] DELETE /identity/v3/projects/3d175ce9f69849ffadc66acf753e0e73 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:16.795495 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.795789 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.796091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.816814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:16.818024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.886589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1324/2643] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:16.895680 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.895974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.896252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.914956 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:16.916217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:16.925281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1320/2644] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:16.929731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:16.939957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7c2b-708b-40d3-a836-22a024c9f134 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.944941 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.945621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.945906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.946186 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.946923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:16.947233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.948927 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:16.963943 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1325/2645] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:43:16.965232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:16.974256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4918eca-21f9-4391-9408-cf786d47cff1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:16.978989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:16.979568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:16.979844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:16.980117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:16.980855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:16.982756 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.008400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1321/2646] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:16 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:17.012519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:17.022496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988092-71ff-4dfd-b57e-ca12f2cd2bff admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:17.079018 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:17.079792 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.080099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.080368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.081097 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:17.083039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.105183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1326/2647] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:17 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:17.109081 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:17.119320 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af0d4d-0f13-4f5b-ac08-b63a5561a9e3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:17.123976 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:17.124758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.124950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.125215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.125933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:17.127802 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.140285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1322/2648] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:17.144653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:17.154614 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dccbee-6978-4406-b39c-c053c585ac43 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:17.159433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:17.160073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.160368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.160661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.161398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:17.162998 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ae9c-bf25-420f-8f1b-ed96cf759892 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.173697 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1327/2649] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:17.178007 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:17.189516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0349bd-eff7-4717-86c5-7910e44db8a1 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:17.194443 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:17.195335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.195604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.195872 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] PATH_INFO: `/v3/projects/3e5d7e8a327242d7882585a899d26818/users/e0c4c1dff79046509be3bd81677d3412/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.211386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5d7e8a327242d7882585a899d26818, user_id=e0c4c1dff79046509be3bd81677d3412, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:17.214077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.228800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1323/2650] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:17 2022] PUT /identity/v3/projects/3e5d7e8a327242d7882585a899d26818/users/e0c4c1dff79046509be3bd81677d3412/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:17.239202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b91e-394c-45c2-81c5-ca31ded229f2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.239494 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b91e-394c-45c2-81c5-ca31ded229f2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.239772 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b91e-394c-45c2-81c5-ca31ded229f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.268095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2267b91e-394c-45c2-81c5-ca31ded229f2 None None] MFA Rules not processed for user `e0c4c1dff79046509be3bd81677d3412`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:17.269355 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2267b91e-394c-45c2-81c5-ca31ded229f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:17.332799 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1328/2651] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:17.346727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:17.348942 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:17.417541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58207be-3a4d-41f6-9a53-23a6878dd13b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:17.422088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2c313f5a654d159c98a2f88b8f4d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:17.422730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:17.423039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:17.423331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:17.434256 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:17.435702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:17.445411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1324/2652] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:24.559738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda6e-e2ab-4718-afe1-c100b76b96bc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:24.560307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda6e-e2ab-4718-afe1-c100b76b96bc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:24.560307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda6e-e2ab-4718-afe1-c100b76b96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:24.578684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a67dda6e-e2ab-4718-afe1-c100b76b96bc None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:24.579893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a67dda6e-e2ab-4718-afe1-c100b76b96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:24.636811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1329/2653] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:24.660291 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:24.661699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:24.733793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d413-43cf-4a72-a27b-cfead2dca013 service glance] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:24.739297 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:24.739950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:24.740244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:24.740599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:24.749136 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:24.750800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:24.759403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1325/2654] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:43:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:43:25.270354 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda52ae-2e82-47f2-94ee-6bfc220002cb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:25.270701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda52ae-2e82-47f2-94ee-6bfc220002cb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:25.271047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda52ae-2e82-47f2-94ee-6bfc220002cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:25.290844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0eda52ae-2e82-47f2-94ee-6bfc220002cb None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:25.292067 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0eda52ae-2e82-47f2-94ee-6bfc220002cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:25.300370 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1330/2655] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:25.313092 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:25.324008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e704-7428-495e-ac8b-c42eef58fdde service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:25.329236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:25.329910 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:25.330192 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:25.330453 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:25.338530 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:25.340138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:25.348316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1326/2656] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:43:25.556254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1136d-f982-4fcd-9c5f-e96743b94255 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:25.556589 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1136d-f982-4fcd-9c5f-e96743b94255 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:25.556872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1136d-f982-4fcd-9c5f-e96743b94255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:25.575375 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4eb1136d-f982-4fcd-9c5f-e96743b94255 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:25.576604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4eb1136d-f982-4fcd-9c5f-e96743b94255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:25.584255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1331/2657] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:25.596659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:25.607784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbff-a615-4c4b-bdc6-171e19cf7e85 service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:25.613570 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:25.614258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:25.614558 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:25.614839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:25.623777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:25.625423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:25.634258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1327/2658] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:43:25.964862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:25.965174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:25.965545 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:25.983982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:25.985215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:25.993599 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1332/2659] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:26.006540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:26.018548 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ac48-ea50-4eab-ae8a-219ac5baa86a service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:26.025373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:26.026276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:26.026615 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:26.026955 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:26.039982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:26.042072 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab442c7-c803-4758-8b90-29d547e76f00 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:26.053186 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1328/2660] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:43:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:43:28.160699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:28.162367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.230189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0d2d-3ea0-45db-acdd-621272b0c63f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:28.235056 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:28.235925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.236204 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.236519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] PATH_INFO: `/v3/users/fdb9cf003d1b4fb7b053ab43739d5b87` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.237760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb9cf003d1b4fb7b053ab43739d5b87)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:28.239774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:28.286842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb9cf003d1b4fb7b053ab43739d5b87'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.287514 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb9cf003d1b4fb7b053ab43739d5b87'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.298823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb9cf003d1b4fb7b053ab43739d5b87'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.305341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb9cf003d1b4fb7b053ab43739d5b87'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.314237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb9cf003d1b4fb7b053ab43739d5b87'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.320488 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1333/2661] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:28 2022] DELETE /identity/v3/users/fdb9cf003d1b4fb7b053ab43739d5b87 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:28.325244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.325773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.325773 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.344157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:28.345408 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.408054 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1329/2662] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:28.418221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:28.419664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.477881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c23d-3dd0-4da8-85ce-5d36d1bc3b85 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:28.481934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:28.482581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.482968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.483252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.492930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:28.494387 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f4f0a-e3eb-49ff-b200-9d979de51555 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:28.503753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1334/2663] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:28.685266 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:28.686964 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.702620 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0feb2-9d57-4f80-97d9-dbafaf8920fa None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:28.707433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:28.708306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.708611 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.708899 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] PATH_INFO: `/v3/projects/6bbb756cc7a349b1a8eae1b170f600aa` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.710284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbb756cc7a349b1a8eae1b170f600aa)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:28.712780 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:28.759229 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbb756cc7a349b1a8eae1b170f600aa', 'request_id': 'req-826199a0-f3ae-4811-9729-70a9e5f4f994'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.764422 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbb756cc7a349b1a8eae1b170f600aa', 'request_id': 'req-826199a0-f3ae-4811-9729-70a9e5f4f994'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.771881 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbb756cc7a349b1a8eae1b170f600aa', 'request_id': 'req-826199a0-f3ae-4811-9729-70a9e5f4f994'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.782844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] The token cache is being invalidate because project 6bbb756cc7a349b1a8eae1b170f600aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:28.783126 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.783755 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-826199a0-f3ae-4811-9729-70a9e5f4f994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:28.785383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1330/2664] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:28 2022] DELETE /identity/v3/projects/6bbb756cc7a349b1a8eae1b170f600aa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:28.790418 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.790718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.790999 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.810137 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:28.811320 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.875192 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1335/2665] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:28.883338 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.883660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.883938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.902677 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:28.903933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:28.912590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1331/2666] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:28.916893 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:28.926502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4beda6-f371-4145-aead-3c7217c4a79f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:28.931314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:28.932026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.932309 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.933008 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.933738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:28.934038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:28.935660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:28.947078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1336/2667] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:28.951481 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:28.960852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96e2a-c4a8-4244-954b-dbe349cfb8fc None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:28.966191 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:28.966844 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:28.967146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:28.967421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:28.968116 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:28.970275 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:28.998688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1332/2668] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:29.002771 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:29.012929 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979fac5-c892-4440-b601-ef4695846c92 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:29.072245 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:29.072950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.073228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.073497 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.074198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:29.076168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:29.097763 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1337/2669] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:29 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:29.101750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:29.112203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c93e7-c99b-474d-b3a8-897dae87daa4 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:29.117276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:29.117966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.118250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.118542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.119258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:29.120947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:29.131499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1333/2670] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:29.135520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:29.146446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b242-803b-4607-a60b-dc1691c4dbb3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:29.152211 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:29.152978 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.153258 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.153515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.154239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:29.155946 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a441adb-4804-42e4-8b6c-d5e397c4e546 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:29.166201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1338/2671] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:29.170553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:29.180684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6315d5-8725-4d87-a20d-81d21f1fa289 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:29.186469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:29.187389 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.187678 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.188010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] PATH_INFO: `/v3/projects/eb89e1020d944ea08b4294be0ac00cbf/users/7efe317417084146a0ff20116ed48cbb/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.202759 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb89e1020d944ea08b4294be0ac00cbf, user_id=7efe317417084146a0ff20116ed48cbb, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:29.205474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:29.219138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1334/2672] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:29 2022] PUT /identity/v3/projects/eb89e1020d944ea08b4294be0ac00cbf/users/7efe317417084146a0ff20116ed48cbb/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:29.224151 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971482e-cf4e-4272-be2b-cdff2d16b600 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.224466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971482e-cf4e-4272-be2b-cdff2d16b600 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.224759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971482e-cf4e-4272-be2b-cdff2d16b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.242590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d971482e-cf4e-4272-be2b-cdff2d16b600 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:29.243820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d971482e-cf4e-4272-be2b-cdff2d16b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:29.304274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1339/2673] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:29.314329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:29.316102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:29.371725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651091f-eeea-48a5-b96b-8915e0100710 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:29.376298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:29.377295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:29.377565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:29.379833 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:29.389831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:29.391438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:29.401323 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1335/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:43:33.263014 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.263553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.264039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.322080 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] MFA Rules not processed for user `7efe317417084146a0ff20116ed48cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:33.323356 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:33.395283 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1340/2675] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:33.399770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.410745 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8a577-c03b-4cf5-b2cb-2c3488a3230a service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.415643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.416350 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.416715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.416996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.417775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.419640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.450944 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1336/2676] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:33 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:33.457000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.468295 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041cc1-946a-4db1-a991-3e7c53640db5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.524227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.524884 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.525165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.525444 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.526223 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.528191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.557214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1341/2677] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:33 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:33.561795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.578797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd989-81f8-44c4-8273-c9ebdaa63fca admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.584650 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.585594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.585874 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.586308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.587128 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.589331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.608048 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1337/2678] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:33.609122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.623522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4f14-ac93-4be0-a07f-beaf1a4f9484 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.628735 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.629648 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.629934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.630209 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] PATH_INFO: `/v3/projects/0a1c3b627294487c9e37a6219d70353f/users/3225f53444924e93a8f317510de3bc94/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.647678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1c3b627294487c9e37a6219d70353f, user_id=3225f53444924e93a8f317510de3bc94, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.651214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.667548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1342/2679] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:33 2022] PUT /identity/v3/projects/0a1c3b627294487c9e37a6219d70353f/users/3225f53444924e93a8f317510de3bc94/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:33.671281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.686345 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280feb-df0b-4bcc-a22c-8d85626ccce7 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.795245 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.797306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.801577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.802043 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.802982 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.811926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.831804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1338/2680] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:33.832280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:33.858935 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58ed8-36a7-400e-9b9c-446bb3f615ae admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:33.864043 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:33.865104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:33.865464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:33.865811 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] PATH_INFO: `/v3/projects/0a1c3b627294487c9e37a6219d70353f/users/3225f53444924e93a8f317510de3bc94/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:33.868809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1c3b627294487c9e37a6219d70353f, user_id=3225f53444924e93a8f317510de3bc94, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:33.871313 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab041e-bef4-4c49-9e1d-d37d3e0173e0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:33.882761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1343/2681] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:33 2022] PUT /identity/v3/projects/0a1c3b627294487c9e37a6219d70353f/users/3225f53444924e93a8f317510de3bc94/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:35.174439 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:35.178535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:35.201182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ba9d-f496-482a-ae0e-82314c1b22e5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:35.303743 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:35.308927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:35.309674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:35.310268 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] PATH_INFO: `/v3/users/e0c4c1dff79046509be3bd81677d3412` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:35.312206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c4c1dff79046509be3bd81677d3412)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:35.315593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:35.434429 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c4c1dff79046509be3bd81677d3412'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:35.452840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c4c1dff79046509be3bd81677d3412'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:35.468029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c4c1dff79046509be3bd81677d3412'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:35.471540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c4c1dff79046509be3bd81677d3412'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:35.506739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c4c1dff79046509be3bd81677d3412'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:35.519127 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1339/2682] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:35 2022] DELETE /identity/v3/users/e0c4c1dff79046509be3bd81677d3412 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:35.523822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:35.524348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:35.524572 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:35.544877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:35.545972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:35.672517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1344/2683] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:35.683763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:35.685316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:35.779933 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff49060-10ef-41cb-8edd-19d7911dc6d8 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:35.784100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:35.784911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:35.785387 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:35.785727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:35.799897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:35.801614 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459771-e806-4f85-9147-df112a7efb30 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:35.812794 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1340/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:36.106062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.107922 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:36.129619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8831d-5da7-4027-bea5-89ad10901e5b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.137910 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.138876 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.139381 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.139862 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] PATH_INFO: `/v3/projects/3e5d7e8a327242d7882585a899d26818` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.141371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5d7e8a327242d7882585a899d26818)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.143846 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.206639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5d7e8a327242d7882585a899d26818', 'request_id': 'req-038d2609-83b0-489f-a4f8-4f3b78f8995b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:36.218858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5d7e8a327242d7882585a899d26818', 'request_id': 'req-038d2609-83b0-489f-a4f8-4f3b78f8995b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:36.231198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5d7e8a327242d7882585a899d26818', 'request_id': 'req-038d2609-83b0-489f-a4f8-4f3b78f8995b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:36.252376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] The token cache is being invalidate because project 3e5d7e8a327242d7882585a899d26818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:36.252835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:36.253745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-038d2609-83b0-489f-a4f8-4f3b78f8995b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:36.255737 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1345/2685] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:36 2022] DELETE /identity/v3/projects/3e5d7e8a327242d7882585a899d26818 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:36.261542 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.262327 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.262752 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.283335 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:36.284834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:36.367865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1341/2686] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:36.377153 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.377437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.378063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.425899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:36.434509 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:36.459322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1346/2687] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:36.464090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.492892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac024-5fe1-410c-9f51-3d81c7eaed85 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.498292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.499090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.499311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.499597 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.500660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:36.500898 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.502525 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.524966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1342/2688] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:36.527899 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.537959 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98112f0-026f-4f28-a7b9-93647b2ace86 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.543904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.544808 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.545077 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.545367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.546089 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.548072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.591821 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1347/2689] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:36.597030 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.609273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d1ae-5e25-43bb-a0ee-72664460777b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.711222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.711928 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.712206 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.712506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.714222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.715215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.744711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1343/2690] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:36 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:36.747523 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.762302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0cb37-12a4-4b72-b85c-18e6e061454c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.773809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.774786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.775368 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.776045 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.777028 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.779037 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.808307 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1348/2691] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:36.808629 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.828260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a913a0-7438-49e0-94e7-bceb2941e27c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.841062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.842277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.843361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.848039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.851837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.851837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a14e72-335d-464f-be04-957b0ab8634d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.867586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1344/2692] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:36.868916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:36.886161 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951292c5-12a9-4d31-b0a9-c4d4d53a526e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:36.894505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:36.897091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.897597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.898047 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] PATH_INFO: `/v3/projects/9e0ed44a944a4b83bba63d86a19f100c/users/aecfeaf37df145bf80bd9d13a547ca49/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.918115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0ed44a944a4b83bba63d86a19f100c, user_id=aecfeaf37df145bf80bd9d13a547ca49, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:36.921655 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:36.944481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1349/2693] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:36 2022] PUT /identity/v3/projects/9e0ed44a944a4b83bba63d86a19f100c/users/aecfeaf37df145bf80bd9d13a547ca49/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:36.957217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:36.957217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:36.957217 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:36.992151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] MFA Rules not processed for user `aecfeaf37df145bf80bd9d13a547ca49`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:36.993720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:37.138972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1345/2694] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:37.143685 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.269196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da07a4-e027-4e65-aba3-3224d6d6a5a1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.280844 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.283629 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.284121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.284661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.288615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.291671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.353696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1350/2695] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:37 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:37.358084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.373687 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a0b43-e74d-4f19-a21c-bc573fa2de81 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.445321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.446035 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.446318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.446590 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.447719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.450782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.490337 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1346/2696] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:37 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:37.493634 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.508332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173c014-7fe4-41e9-ac54-064a33ff8b53 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.514563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.515432 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.515810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.516178 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.517135 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.518901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.535318 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.535574 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1351/2697] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:37.547800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778fb6d-bf73-4f58-83dc-bf9218405737 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.552907 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.553640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.553988 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.554270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.555326 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.557231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052eb7-be8d-4ab0-975f-c5299fe3e9aa admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.574188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.584662 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1347/2698] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:37.587350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21dbb-f5c6-4425-b029-15664e137024 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.593570 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.594511 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.594788 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.595083 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] PATH_INFO: `/v3/projects/c34f1613a4784fd181b6693e632c1a6c/users/b6f3c27670c34f5d8478cce921a3a8d1/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.612982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f1613a4784fd181b6693e632c1a6c, user_id=b6f3c27670c34f5d8478cce921a3a8d1, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.615678 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.644751 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1352/2699] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:37 2022] PUT /identity/v3/projects/c34f1613a4784fd181b6693e632c1a6c/users/b6f3c27670c34f5d8478cce921a3a8d1/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:37.648651 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.648940 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.649239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.695533 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] MFA Rules not processed for user `b6f3c27670c34f5d8478cce921a3a8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:37.697242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:37.802267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1348/2700] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:37.803241 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:37.911749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44ba2-82dd-4376-ad70-439f112753cd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:37.926621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:37.927636 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:37.928128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:37.930400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:37.931416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:37.934098 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:37.993841 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.001116 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1353/2701] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:37 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:38.006788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c07249-9884-4f62-bd49-bf311a428ba3 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.072902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.073738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.074119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.074495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.075293 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.077447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.108371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1349/2702] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:37 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:38.112945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.125021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046c5a-4c2f-429f-b38e-35b052cc1cc4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.132237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.133242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.133724 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.134227 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.135057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.137016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.148579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1354/2703] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:38.153365 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.165505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfae2-a0b9-4574-b232-ab286394e97a admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.173831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.174172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.174785 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.174948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] PATH_INFO: `/v3/projects/b651d9d0948c4034ba1921d129c29dfa/users/dbaa71e44c58442786a090d6ac00e284/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.194407 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651d9d0948c4034ba1921d129c29dfa, user_id=dbaa71e44c58442786a090d6ac00e284, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.197276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.213661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1350/2704] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:38 2022] PUT /identity/v3/projects/b651d9d0948c4034ba1921d129c29dfa/users/dbaa71e44c58442786a090d6ac00e284/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:38.217290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.229286 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a828-9c51-4e6c-a056-131316babc50 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.313486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.314194 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.314524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.314768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.315529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.317222 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f996f-0dda-46a3-a38f-257a1561761d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.331310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1355/2705] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:38.334234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.346078 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27930e6-c6fd-4685-8469-ff049275ee46 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.351730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.352860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.353140 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.353411 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] PATH_INFO: `/v3/projects/b651d9d0948c4034ba1921d129c29dfa/users/dbaa71e44c58442786a090d6ac00e284/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.357459 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651d9d0948c4034ba1921d129c29dfa, user_id=dbaa71e44c58442786a090d6ac00e284, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.361006 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.384232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1351/2706] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:38 2022] PUT /identity/v3/projects/b651d9d0948c4034ba1921d129c29dfa/users/dbaa71e44c58442786a090d6ac00e284/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:38.386896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7071dcc-54c1-4715-a37c-d79868a49cbd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.387431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7071dcc-54c1-4715-a37c-d79868a49cbd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.388215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7071dcc-54c1-4715-a37c-d79868a49cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.416722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f7071dcc-54c1-4715-a37c-d79868a49cbd None None] MFA Rules not processed for user `dbaa71e44c58442786a090d6ac00e284`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:38.418294 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f7071dcc-54c1-4715-a37c-d79868a49cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:38.518856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1356/2707] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:38.531810 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:38.533926 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:38.625139 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e6677-bc94-49e2-8182-8291593bd2df admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:38.629673 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:38.630501 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.630857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.631339 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:38.706924 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:38.708384 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:38.719392 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1352/2708] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:38.995911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:38.996466 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:38.996588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:39.025057 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] MFA Rules not processed for user `3225f53444924e93a8f317510de3bc94`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:39.026847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:39.148530 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1357/2709] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:39.159261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:39.160784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:39.243853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37771-2a4e-4ca2-99ef-d20b1220b23a service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:39.249529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:39.250205 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:39.250487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:39.250762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:39.252916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:39.322184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:39.324174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb9b82-fd5c-4e6e-81f7-571778dc7423 service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:39.342469 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1353/2710] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:40.301624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:40.303259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:40.316235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78195e3-d652-4c0f-8f4e-583392fc8e6a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:40.321185 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:40.321857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:40.322142 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:40.322414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:40.397138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:40.397138 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:40.399027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290c6d-f332-436f-93ce-93401927796d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:40.399498 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290c6d-f332-436f-93ce-93401927796d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:40.399774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290c6d-f332-436f-93ce-93401927796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:40.407062 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1358/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:40.418435 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-1f290c6d-f332-436f-93ce-93401927796d None None] MFA Rules not processed for user `7efe317417084146a0ff20116ed48cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:40.420322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-1f290c6d-f332-436f-93ce-93401927796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:40.429184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1354/2712] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:40.966706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:40.975322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc30219-032c-47db-87cd-9a9a7e3a9a2f service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:40.978961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:40.979619 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:40.979897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:40.980169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:40.989016 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:40.990434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf1e36-341b-45c4-9c0c-0f17b9edd3f4 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:40.999883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1359/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:44.943775 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290c6d-f332-436f-93ce-93401927796d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:45.009900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290c6d-f332-436f-93ce-93401927796d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:45.014639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:45.015529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:45.015806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:45.016090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] PATH_INFO: `/v3/users/aecfeaf37df145bf80bd9d13a547ca49` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:45.017451 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecfeaf37df145bf80bd9d13a547ca49)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:45.019532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:45.076340 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecfeaf37df145bf80bd9d13a547ca49'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.088694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecfeaf37df145bf80bd9d13a547ca49'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.095182 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecfeaf37df145bf80bd9d13a547ca49'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.095919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecfeaf37df145bf80bd9d13a547ca49'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.104509 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecfeaf37df145bf80bd9d13a547ca49'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.116174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1355/2714] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:44 2022] DELETE /identity/v3/users/aecfeaf37df145bf80bd9d13a547ca49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:45.120883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:45.121358 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:45.121902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:45.140481 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:45.141830 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:45.212803 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1360/2715] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:45.219659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:45.221315 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:45.283273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf62d0-a8f1-40ec-a6f9-0d79ba74d79b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:45.287098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:45.287751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:45.288012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:45.288301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:45.297491 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:45.298915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:45.309462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1356/2716] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:45.753276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:45.755420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:45.795569 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533c97-c4aa-410a-b453-63dcb4faba4a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:45.810659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:45.812804 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:45.813184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:45.813560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] PATH_INFO: `/v3/projects/9e0ed44a944a4b83bba63d86a19f100c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:45.814982 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0ed44a944a4b83bba63d86a19f100c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:45.817908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:45.905877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0ed44a944a4b83bba63d86a19f100c', 'request_id': 'req-1327c19e-5976-4f15-b20a-4ebefe9e636d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.912609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0ed44a944a4b83bba63d86a19f100c', 'request_id': 'req-1327c19e-5976-4f15-b20a-4ebefe9e636d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.928639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0ed44a944a4b83bba63d86a19f100c', 'request_id': 'req-1327c19e-5976-4f15-b20a-4ebefe9e636d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.950007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] The token cache is being invalidate because project 9e0ed44a944a4b83bba63d86a19f100c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:45.950496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.951413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:45.956010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1361/2717] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:45 2022] DELETE /identity/v3/projects/9e0ed44a944a4b83bba63d86a19f100c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:45.957717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:45.970027 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a670985-2fa7-4b89-9f1e-888a7f794f77 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:46.043855 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:46.044852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:46.045204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:46.045546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] PATH_INFO: `/v3/users/b6f3c27670c34f5d8478cce921a3a8d1` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:46.046764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3c27670c34f5d8478cce921a3a8d1)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:46.048900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:46.101925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3c27670c34f5d8478cce921a3a8d1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.115640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3c27670c34f5d8478cce921a3a8d1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.126123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3c27670c34f5d8478cce921a3a8d1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.126891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3c27670c34f5d8478cce921a3a8d1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.137091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3c27670c34f5d8478cce921a3a8d1'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.144935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1357/2718] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:45 2022] DELETE /identity/v3/users/b6f3c27670c34f5d8478cce921a3a8d1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:46.430665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:46.433091 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:46.447141 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327c19e-5976-4f15-b20a-4ebefe9e636d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:46.507990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:46.508815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:46.509099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:46.509369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] PATH_INFO: `/v3/projects/c34f1613a4784fd181b6693e632c1a6c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:46.510609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34f1613a4784fd181b6693e632c1a6c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:46.512663 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:46.567398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34f1613a4784fd181b6693e632c1a6c', 'request_id': 'req-6889d97e-cb0d-484b-a9ab-3e492599ae11'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.573284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34f1613a4784fd181b6693e632c1a6c', 'request_id': 'req-6889d97e-cb0d-484b-a9ab-3e492599ae11'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.583972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34f1613a4784fd181b6693e632c1a6c', 'request_id': 'req-6889d97e-cb0d-484b-a9ab-3e492599ae11'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.595853 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] The token cache is being invalidate because project c34f1613a4784fd181b6693e632c1a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:46.596144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.596793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.598642 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1362/2719] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:46 2022] DELETE /identity/v3/projects/c34f1613a4784fd181b6693e632c1a6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:46.602992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:46.604454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:46.617446 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a75c24-d330-4202-8783-4e96b6b7893c admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:46.675130 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:46.676227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:46.676560 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:46.676857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] PATH_INFO: `/v3/users/dbaa71e44c58442786a090d6ac00e284` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:46.678134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbaa71e44c58442786a090d6ac00e284)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:46.680199 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:46.732716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbaa71e44c58442786a090d6ac00e284'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.744331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbaa71e44c58442786a090d6ac00e284'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.752260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbaa71e44c58442786a090d6ac00e284'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.753049 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbaa71e44c58442786a090d6ac00e284'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.762300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-fbfbf979-cf00-4e70-bba2-3eb107f0a1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbaa71e44c58442786a090d6ac00e284'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:46.769330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1358/2720] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:46 2022] DELETE /identity/v3/users/dbaa71e44c58442786a090d6ac00e284 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:43:47.135023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.137782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:47.158443 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d97e-cb0d-484b-a9ab-3e492599ae11 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.247615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.248540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.248855 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.249129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] PATH_INFO: `/v3/projects/b651d9d0948c4034ba1921d129c29dfa` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.250350 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b651d9d0948c4034ba1921d129c29dfa)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.252291 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.299525 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b651d9d0948c4034ba1921d129c29dfa', 'request_id': 'req-ee054a2a-55ae-4659-8226-afd2808f82b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:47.304964 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b651d9d0948c4034ba1921d129c29dfa', 'request_id': 'req-ee054a2a-55ae-4659-8226-afd2808f82b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:47.314026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b651d9d0948c4034ba1921d129c29dfa', 'request_id': 'req-ee054a2a-55ae-4659-8226-afd2808f82b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:47.325502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] The token cache is being invalidate because project b651d9d0948c4034ba1921d129c29dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:47.325867 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:47.326541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ee054a2a-55ae-4659-8226-afd2808f82b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:47.328485 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1363/2721] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:47 2022] DELETE /identity/v3/projects/b651d9d0948c4034ba1921d129c29dfa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:47.333207 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.333716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.333814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.351729 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:47.353024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:47.421113 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1359/2722] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:47.429157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e42d-4241-442d-8180-d46653ff052a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.429437 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e42d-4241-442d-8180-d46653ff052a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.429709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e42d-4241-442d-8180-d46653ff052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.449072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b402e42d-4241-442d-8180-d46653ff052a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:47.450454 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b402e42d-4241-442d-8180-d46653ff052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:47.458756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1364/2723] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:47.463155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.473316 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa96b-e878-4bf4-8a33-ab2162f5a9bb None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.478343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.479017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.479301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.479582 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.480347 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:47.480689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.482476 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.497467 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1360/2724] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:47.499274 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e42d-4241-442d-8180-d46653ff052a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.509687 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e42d-4241-442d-8180-d46653ff052a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.515413 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.516145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.516461 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.516742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.517484 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.519411 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.546710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1365/2725] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:47 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:47.551301 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.562184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9cb7-c695-411b-b0b0-21aeb499ce50 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.623850 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.624559 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.624837 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.625108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.625831 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.627741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.652679 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1361/2726] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:47 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:47.654528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.675450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21fee-ac97-42da-95e3-34208224e4c3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.681026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.681736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.682030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.682311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.683035 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.685154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.695952 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1366/2727] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:47.700252 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.713857 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f892a8-ae13-43eb-b8b5-c63676d59a90 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.718763 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.719441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.719725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.720004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.720769 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.722507 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5d017-d34f-43c7-9038-28cbf3ed2f2c admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.733461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1362/2728] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:47.737660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.747933 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fbd7-99c8-4676-957b-cc6408d6c5cf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.753124 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.753993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.754267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.754540 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] PATH_INFO: `/v3/projects/44a8eececb3a47e2b5c26fb1b64d1164/users/4c13c8ce52e9427288a93ba303fee859/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.770456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a8eececb3a47e2b5c26fb1b64d1164, user_id=4c13c8ce52e9427288a93ba303fee859, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.773674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.788348 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1367/2729] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:47 2022] PUT /identity/v3/projects/44a8eececb3a47e2b5c26fb1b64d1164/users/4c13c8ce52e9427288a93ba303fee859/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:47.798876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.799198 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.799477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.825641 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] MFA Rules not processed for user `4c13c8ce52e9427288a93ba303fee859`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:47.826762 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:47.901002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1363/2730] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:47.912314 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:47.914262 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:47.975036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0873d-d423-4ed2-aa19-6a7afa4bdf0c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:47.979168 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:47.979823 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:47.980109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:47.980384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:47.989568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:47.991021 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3df28-ed15-4a9e-ba5b-7182cc8f71de service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:47.999782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1368/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:48.027383 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:48.095165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1c10c-1392-42b2-8183-c6394fd0f6e2 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:48.100236 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:48.101146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.101426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.101699 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] PATH_INFO: `/v3/users/4c13c8ce52e9427288a93ba303fee859` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.102914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c13c8ce52e9427288a93ba303fee859)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:48.104869 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:48.153011 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c13c8ce52e9427288a93ba303fee859'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.166102 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c13c8ce52e9427288a93ba303fee859'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.173643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c13c8ce52e9427288a93ba303fee859'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.174444 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c13c8ce52e9427288a93ba303fee859'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.183211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c13c8ce52e9427288a93ba303fee859'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.190916 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1364/2732] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:48 2022] DELETE /identity/v3/users/4c13c8ce52e9427288a93ba303fee859 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:48.195527 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.195850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.196130 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.215701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:48.217408 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:48.283548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1369/2733] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:43:48.294159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:48.295809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:48.356053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271599c9-555b-4d8d-8437-0f74163c6699 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:48.360111 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:48.360806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.361089 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.361364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.370700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:48.372180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad37d6-ace6-48f2-8fe8-558fcb81b656 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:48.381653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1365/2734] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:48.658450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:48.661140 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:48.673727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c68f35-95a5-4f34-bdf4-c627715f1c70 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:48.679101 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:48.680019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.680202 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.680718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] PATH_INFO: `/v3/projects/44a8eececb3a47e2b5c26fb1b64d1164` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.681908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a8eececb3a47e2b5c26fb1b64d1164)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:48.684195 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:48.740254 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a8eececb3a47e2b5c26fb1b64d1164', 'request_id': 'req-7f3b59af-eeae-4566-94dc-abbef3306bf5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.746025 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a8eececb3a47e2b5c26fb1b64d1164', 'request_id': 'req-7f3b59af-eeae-4566-94dc-abbef3306bf5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.754332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a8eececb3a47e2b5c26fb1b64d1164', 'request_id': 'req-7f3b59af-eeae-4566-94dc-abbef3306bf5'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.766915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] The token cache is being invalidate because project 44a8eececb3a47e2b5c26fb1b64d1164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:48.767152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.767897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7f3b59af-eeae-4566-94dc-abbef3306bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:48.769591 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1370/2735] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:48 2022] DELETE /identity/v3/projects/44a8eececb3a47e2b5c26fb1b64d1164 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:48.775492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.775784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.776085 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.796556 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:48.797975 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:48.864478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1366/2736] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:48.875871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.875871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.875871 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.894376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:48.895622 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:48.903797 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1371/2737] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:48.908274 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:48.918774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6b0fd-15f6-4cf8-8652-7a792fc6f538 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:48.924169 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:48.924908 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.925223 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.925463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.926227 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:48.926506 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:48.928158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:48.941103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1367/2738] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:48.945812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:48.955179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4903a-d9eb-409e-90ba-fd861bf7326c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:48.960507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:48.961169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:48.961448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:48.961859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:48.962616 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:48.964592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:48.991256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1372/2739] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:48 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:48.996175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:49.006594 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31f771-0f57-4fc4-809b-0e49b7af9406 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:49.067995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:49.068827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.069120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.069557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.070306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:49.072284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:49.094354 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1368/2740] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:48 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:49.098410 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:49.109580 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea0490-5477-465d-a52d-7a3ff2088fc4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:49.115339 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:49.115953 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.116236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.116548 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.117298 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:49.119267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:49.131369 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1373/2741] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:49.135271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:49.147181 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34366ab4-900e-45a3-b7ef-2308362728b0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:49.153441 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:49.154189 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.154554 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.154865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.155625 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:49.157285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747578-d30c-4ae1-a3d8-085b268cbd9b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:49.169627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1369/2742] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:49.174493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:49.187667 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ac35-7a34-4418-aca4-9bb9237f2bf1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:49.192516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:49.193420 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.193709 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.193987 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] PATH_INFO: `/v3/projects/579a6c29476643ed997c798ed64bc409/users/28b413f53d6e404fa3d613d21d07afc7/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.208564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579a6c29476643ed997c798ed64bc409, user_id=28b413f53d6e404fa3d613d21d07afc7, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:49.211215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:49.226786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1374/2743] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:49 2022] PUT /identity/v3/projects/579a6c29476643ed997c798ed64bc409/users/28b413f53d6e404fa3d613d21d07afc7/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:49.232178 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69004d0-878a-43d3-83a9-bfdb2589f00a None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.232472 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69004d0-878a-43d3-83a9-bfdb2589f00a None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.232776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69004d0-878a-43d3-83a9-bfdb2589f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.251214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-d69004d0-878a-43d3-83a9-bfdb2589f00a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:49.252426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-d69004d0-878a-43d3-83a9-bfdb2589f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:49.319390 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1370/2744] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:49.329281 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:49.331271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:49.393755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ebd0e-0d12-495d-9849-d892467caaf1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:49.397611 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:49.398260 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:49.398541 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:49.398815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:49.407732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:49.409208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:49.418674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1375/2745] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:50.027372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579122-a566-47e5-9f46-1f8f80cc401f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:50.027786 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579122-a566-47e5-9f46-1f8f80cc401f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:50.028063 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579122-a566-47e5-9f46-1f8f80cc401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:50.061015 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-18579122-a566-47e5-9f46-1f8f80cc401f None None] MFA Rules not processed for user `28b413f53d6e404fa3d613d21d07afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:50.065716 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-18579122-a566-47e5-9f46-1f8f80cc401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:50.105284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:50.114112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bbfc4-f9fc-4af8-a1b0-9cea016d7831 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:50.117820 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:50.118435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:50.118740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:50.119011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:50.120837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:50.134490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:50.136165 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:50.154632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1376/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:43:50.157019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1371/2747] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:50.168072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:50.169904 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:50.236517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dae3-0e4c-4dfc-a53e-4287c2eedd9d service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:50.240156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:50.240843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:50.241212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:50.241493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:50.250235 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:50.251755 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:50.262066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1377/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:43:51.638222 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:51.639282 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:51.640013 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:51.658996 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] MFA Rules not processed for user `28b413f53d6e404fa3d613d21d07afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:51.661258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:51.669137 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1372/2749] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:53.765618 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:53.768074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:53.794520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca7d2-b5e6-4d11-8187-2484ae3f41e9 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:53.801435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:53.804261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:53.804760 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:53.805112 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] PATH_INFO: `/v3/users/de3dd9262fba4830be6c4477628f2061` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:53.806578 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3dd9262fba4830be6c4477628f2061)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:53.809419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:53.883990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3dd9262fba4830be6c4477628f2061'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:53.885071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3dd9262fba4830be6c4477628f2061'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:53.905856 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3dd9262fba4830be6c4477628f2061'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:53.915857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3dd9262fba4830be6c4477628f2061'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:53.941819 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c9f3bd72-6d14-44cc-83aa-ae649e84ead7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3dd9262fba4830be6c4477628f2061'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:53.958038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1378/2750] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:43:53 2022] DELETE /identity/v3/users/de3dd9262fba4830be6c4477628f2061 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:54.261749 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.273333 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f57ab-bda8-4d8b-926a-dfa34b8ef25d None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.335084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.335962 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.336243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.336586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] PATH_INFO: `/v3/projects/970ed3a09b3e490399fa39d38e97f9cb` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.338550 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970ed3a09b3e490399fa39d38e97f9cb)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.342231 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.391734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970ed3a09b3e490399fa39d38e97f9cb', 'request_id': 'req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:54.397674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970ed3a09b3e490399fa39d38e97f9cb', 'request_id': 'req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:54.405958 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970ed3a09b3e490399fa39d38e97f9cb', 'request_id': 'req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:54.417147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] The token cache is being invalidate because project 970ed3a09b3e490399fa39d38e97f9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:43:54.417431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:54.418146 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-f4ad1fa7-a02d-4cd5-8115-d207ea889d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:43:54.419829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1373/2751] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:43:54 2022] DELETE /identity/v3/projects/970ed3a09b3e490399fa39d38e97f9cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:54.425121 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.425395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.425662 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.445303 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:54.446564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:54.519571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1379/2752] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:54.522039 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.522399 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.522852 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.542376 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:54.543751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:54.552897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1374/2753] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:54.557158 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.567473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e7bb-a536-4f61-b9ce-9545edb61a32 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.573256 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.574310 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.574722 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.575118 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.576333 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:43:54.576693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.578843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.594587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1380/2754] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:43:54.595715 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.605234 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e3d7-b29c-45fe-a0f1-8341414136a9 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.610565 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.611336 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.611624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.611902 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.612776 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.614777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.642230 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1375/2755] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:43:54 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:43:54.646553 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.656759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bcae6-6d8b-418c-a5b9-ca133cae2a90 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.716041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.716741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.717011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.717302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.718004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.719937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.741699 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1381/2756] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:43:54 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:43:54.745948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.756168 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dfa60-fe0d-4824-b76b-f8a3becdf4e5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.760832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.761488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.761774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.762052 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.762861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.764505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.774856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1376/2757] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:43:54.778912 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.790075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8d26-0d04-498a-b3b5-672d1299d240 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.794768 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.795435 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.795718 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.795990 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.796796 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.798403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64601-f9d3-4b98-beca-c086141cd0a8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.811110 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1382/2758] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:43:54.815438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.825997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320d7be-1784-4cee-96b0-a4d8146c3566 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:54.830577 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:54.831473 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.831747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.832010 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] PATH_INFO: `/v3/projects/1ccbb9b8d11b499cb9e84da27dd464e6/users/0e56ccc11ac043af908dbfe3a10c9a55/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.845989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccbb9b8d11b499cb9e84da27dd464e6, user_id=0e56ccc11ac043af908dbfe3a10c9a55, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:54.848702 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:54.862640 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1377/2759] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:43:54 2022] PUT /identity/v3/projects/1ccbb9b8d11b499cb9e84da27dd464e6/users/0e56ccc11ac043af908dbfe3a10c9a55/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:54.867908 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cc00-d320-42a1-838c-bcb0d83cf958 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:54.868198 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cc00-d320-42a1-838c-bcb0d83cf958 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:54.868493 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cc00-d320-42a1-838c-bcb0d83cf958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:54.887401 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8d78cc00-d320-42a1-838c-bcb0d83cf958 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:43:54.888842 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8d78cc00-d320-42a1-838c-bcb0d83cf958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:54.971654 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1383/2760] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:43:54.973077 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:54.975462 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:55.039403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d174a-bff2-4cf8-a59d-e5d2ac50b480 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:55.043184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:55.044036 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:55.044321 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:55.044663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:55.056151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:55.057854 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:55.072322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1378/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:44:00.083807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be00e-24a1-4dfe-a152-82cebb17241b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:00.084319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be00e-24a1-4dfe-a152-82cebb17241b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:00.084416 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be00e-24a1-4dfe-a152-82cebb17241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:00.131277 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ac6be00e-24a1-4dfe-a152-82cebb17241b None None] MFA Rules not processed for user `0e56ccc11ac043af908dbfe3a10c9a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:44:00.133090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ac6be00e-24a1-4dfe-a152-82cebb17241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:00.274632 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1384/2762] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:44:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:44:00.289648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:44:00.291723 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:00.395915 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03363ad-0dc9-4482-811c-7f6edc159971 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:44:00.401938 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:44:00.402965 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:00.403524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:00.403989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:00.413423 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:44:00.415366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:44:00.439758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1379/2763] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:44:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:44:02.034104 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:02.035055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:02.035372 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:02.056852 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] MFA Rules not processed for user `0e56ccc11ac043af908dbfe3a10c9a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:44:02.058188 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:02.065702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1385/2764] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:44:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:44:13.565694 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:44:13.576105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca84e5-771e-47ee-a86f-24740d73b42e service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:44:13.580040 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:44:13.580717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:13.580997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:13.581271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:13.583237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:13.646261 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:44:13.647727 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dfb4-5040-452a-bad9-ca4302be1faa service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:44:13.657405 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1380/2765] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:44:50.957315 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:44:50.958983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:51.022175 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef354d2-10ec-4104-b7d4-9449fbd7da3b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:44:51.025791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:44:51.026450 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:51.026730 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:51.027004 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:51.028945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:51.091809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:44:51.093330 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410c27d-7f88-4686-afc1-80184e6f297e service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:44:51.102720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1386/2766] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:44:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:44:57.559378 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a12c3-e39c-4360-9fc3-be6d05d9454b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:44:57.559925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a12c3-e39c-4360-9fc3-be6d05d9454b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:44:57.559925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a12c3-e39c-4360-9fc3-be6d05d9454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:44:57.579105 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-646a12c3-e39c-4360-9fc3-be6d05d9454b None None] MFA Rules not processed for user `28b413f53d6e404fa3d613d21d07afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:44:57.580306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-646a12c3-e39c-4360-9fc3-be6d05d9454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:44:57.642156 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1381/2767] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:45:00.094961 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496d4d-4858-4ba7-9b55-48b25d945f42 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:00.095568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496d4d-4858-4ba7-9b55-48b25d945f42 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:00.095568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496d4d-4858-4ba7-9b55-48b25d945f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:00.116038 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-87496d4d-4858-4ba7-9b55-48b25d945f42 None None] MFA Rules not processed for user `6fa431ce09e44b85b61af972bbce2ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:45:00.117376 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87496d4d-4858-4ba7-9b55-48b25d945f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:45:00.124465 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1387/2768] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:45:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:45:33.701402 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6765a5-963e-4e50-b1ef-f674e9d2bbaf None None] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:33.701905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6765a5-963e-4e50-b1ef-f674e9d2bbaf None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:33.701905 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6765a5-963e-4e50-b1ef-f674e9d2bbaf None None] PATH_INFO: `/` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:33.703343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1382/2769] 10.222.0.49 () {54 vars in 960 bytes} [Mon May 16 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:45:33.708560 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:33.709000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:33.709111 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:33.746228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] MFA Rules not processed for user `fec791a20cf54413ab307c7a66892259`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:45:33.747452 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:45:33.809524 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1388/2770] 10.222.0.49 () {58 vars in 1057 bytes} [Mon May 16 20:45:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:45:33.818046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6765a5-963e-4e50-b1ef-f674e9d2bbaf None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:45:33.831858 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6765a5-963e-4e50-b1ef-f674e9d2bbaf None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:45:33.838108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:45:33.838764 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:33.839055 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:33.839325 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:33.841310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:45:33.853901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:45:33.855541 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:45:33.865777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1383/2771] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:45:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:45:58.446562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:45:58.448719 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:45:58.462516 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cf6c-ca82-41d2-a3d2-3eafd6151d86 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:45:58.467579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:45:58.468501 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:58.468786 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:58.469063 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] PATH_INFO: `/v3/users/28b413f53d6e404fa3d613d21d07afc7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:58.470268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b413f53d6e404fa3d613d21d07afc7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:45:58.472212 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:45:58.518579 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b413f53d6e404fa3d613d21d07afc7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.519157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b413f53d6e404fa3d613d21d07afc7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.531020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b413f53d6e404fa3d613d21d07afc7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.537872 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b413f53d6e404fa3d613d21d07afc7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.546689 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d76d5a7e-3c12-4d01-8b0f-6ec8a1d3fb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b413f53d6e404fa3d613d21d07afc7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.553217 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1389/2772] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:45:58 2022] DELETE /identity/v3/users/28b413f53d6e404fa3d613d21d07afc7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:45:58.728505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:45:58.741165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37253d-2bdd-4f26-ae26-7b5a2dbb83bb service placement] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:45:58.804543 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:45:58.805393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:45:58.805674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:45:58.805948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] PATH_INFO: `/v3/projects/579a6c29476643ed997c798ed64bc409` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:45:58.807276 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579a6c29476643ed997c798ed64bc409)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:45:58.809247 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:45:58.854540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579a6c29476643ed997c798ed64bc409', 'request_id': 'req-e664b90d-0be5-4cec-9889-fd0253596db8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.859742 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579a6c29476643ed997c798ed64bc409', 'request_id': 'req-e664b90d-0be5-4cec-9889-fd0253596db8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.867471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579a6c29476643ed997c798ed64bc409', 'request_id': 'req-e664b90d-0be5-4cec-9889-fd0253596db8'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.878887 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] The token cache is being invalidate because project 579a6c29476643ed997c798ed64bc409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:45:58.879175 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.879895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e664b90d-0be5-4cec-9889-fd0253596db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:45:58.881586 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1384/2773] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:45:58 2022] DELETE /identity/v3/projects/579a6c29476643ed997c798ed64bc409 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:46:34.935515 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:46:34.936060 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:46:34.936177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:46:34.937502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1390/2774] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 16 20:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:46:34.943798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:46:34.944304 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:46:34.944537 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:46:34.962900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] MFA Rules not processed for user `e8ed0368b15743bb8a8cec086c575d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:46:34.964106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:46:35.030278 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1385/2775] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 16 20:46:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:46:35.040784 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:46:35.042564 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:46:35.103229 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac38ed-f317-42fe-95ed-ac7d728175de None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:46:35.107171 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:46:35.108167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:46:35.108464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:46:35.108738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:46:35.119972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:46:35.121458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:46:35.134529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1391/2776] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:46:56.702973 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:46:56.704809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:46:56.718281 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc98b8-7278-4873-a8d7-522638b3879e None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:46:56.723228 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:46:56.723878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:46:56.724165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:46:56.724477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:46:56.726768 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:46:56.740703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:46:56.742150 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06292-008d-4a9b-bd69-20cb99edb621 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:46:56.753056 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1386/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:46:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:46:57.938331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:46:57.947490 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642347-f1f8-49b5-968e-983e20a00861 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:46:57.951503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:46:57.952149 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:46:57.952431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:46:57.952734 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:46:57.954923 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:46:57.969528 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:46:57.970972 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:46:57.983027 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1392/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:47:02.290793 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:02.291317 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:02.291426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:02.310053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] MFA Rules not processed for user `0e56ccc11ac043af908dbfe3a10c9a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:47:02.311254 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:02.366990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1387/2779] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:47:03.447270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:03.458233 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15172-81fe-43e2-b793-184eeccbd7fa service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:03.463686 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:03.464609 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:03.464989 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:03.465500 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:03.476331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:03.494433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:03.496249 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:03.510869 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1393/2780] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:47:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:47:15.822431 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:15.832358 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab163c-fc0a-4f70-ae83-d9fd523a613b None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:15.836329 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:15.837106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:15.837454 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:15.837799 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:15.839634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:15.904584 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:15.906214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:15.915877 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1388/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:47:21.962949 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:21.965334 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:21.982207 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30856d-84db-4dd1-9228-0c85206329ba service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:21.988076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:21.989040 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:21.989321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:21.989602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] PATH_INFO: `/v3/users/6fa431ce09e44b85b61af972bbce2ed4` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:21.990960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa431ce09e44b85b61af972bbce2ed4)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:21.992942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:22.042261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa431ce09e44b85b61af972bbce2ed4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.042993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa431ce09e44b85b61af972bbce2ed4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.054133 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa431ce09e44b85b61af972bbce2ed4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.060610 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa431ce09e44b85b61af972bbce2ed4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.070536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa431ce09e44b85b61af972bbce2ed4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.077981 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1394/2782] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:47:21 2022] DELETE /identity/v3/users/6fa431ce09e44b85b61af972bbce2ed4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:47:22.264461 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:22.276738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fb4-f2f9-4b43-a3ef-fdd58580007c service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:22.335084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:22.335957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:22.336237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:22.336568 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] PATH_INFO: `/v3/projects/710ecde5160640149c693e0c2b0b0354` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:22.337772 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710ecde5160640149c693e0c2b0b0354)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:22.339738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:22.385133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710ecde5160640149c693e0c2b0b0354', 'request_id': 'req-89ded75c-f1d7-42b3-89c9-77349b632082'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.390433 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710ecde5160640149c693e0c2b0b0354', 'request_id': 'req-89ded75c-f1d7-42b3-89c9-77349b632082'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.398289 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710ecde5160640149c693e0c2b0b0354', 'request_id': 'req-89ded75c-f1d7-42b3-89c9-77349b632082'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.409184 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] The token cache is being invalidate because project 710ecde5160640149c693e0c2b0b0354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:47:22.409470 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.410135 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.411714 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1389/2783] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:47:22 2022] DELETE /identity/v3/projects/710ecde5160640149c693e0c2b0b0354 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:47:22.415857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:22.417317 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:22.430321 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf0c7-2fda-432c-9f26-20d4f282cded admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:22.493963 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:22.495177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:22.495529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:22.495956 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] PATH_INFO: `/v3/users/b631576565c8472ea2d23a6cefbb8916` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:22.497664 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b631576565c8472ea2d23a6cefbb8916)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:22.499604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:22.546612 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b631576565c8472ea2d23a6cefbb8916'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.547184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b631576565c8472ea2d23a6cefbb8916'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.560693 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b631576565c8472ea2d23a6cefbb8916'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.568780 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b631576565c8472ea2d23a6cefbb8916'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.577837 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b631576565c8472ea2d23a6cefbb8916'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.587833 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1395/2784] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:47:22 2022] DELETE /identity/v3/users/b631576565c8472ea2d23a6cefbb8916 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:47:22.787087 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:47:22.788642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:47:22.802721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded75c-f1d7-42b3-89c9-77349b632082 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:47:22.860269 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:47:22.861173 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:47:22.861458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:47:22.861734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] PATH_INFO: `/v3/projects/470cc6e3395540ab8047886dbb5a8551` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:47:22.862922 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=470cc6e3395540ab8047886dbb5a8551)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:47:22.865147 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:47:22.915088 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470cc6e3395540ab8047886dbb5a8551', 'request_id': 'req-398b1239-d569-4f02-8650-cb7700cba55b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.921177 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470cc6e3395540ab8047886dbb5a8551', 'request_id': 'req-398b1239-d569-4f02-8650-cb7700cba55b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.929943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470cc6e3395540ab8047886dbb5a8551', 'request_id': 'req-398b1239-d569-4f02-8650-cb7700cba55b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.943012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] The token cache is being invalidate because project 470cc6e3395540ab8047886dbb5a8551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:47:22.943271 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.944079 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:47:22.946889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1390/2785] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:47:22 2022] DELETE /identity/v3/projects/470cc6e3395540ab8047886dbb5a8551 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:01.203464 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:01.205031 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:01.286974 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076fe5-6d5d-47db-a02a-b2378e0fbc26 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:01.358646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:01.358915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:01.359033 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:01.359332 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:01.361284 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:01.374201 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:01.375911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:01.387742 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1396/2786] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:04.506163 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:04.507675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:04.524242 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1239-d569-4f02-8650-cb7700cba55b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:04.530201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:04.531023 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:04.531426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:04.531645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:04.533585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:04.546950 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:04.548748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:04.560540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1391/2787] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:13.869000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:13.870529 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:13.938897 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46023a-f212-4f5e-8ee2-f7e98e8550c7 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:13.943740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:13.944680 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:13.944968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:13.945275 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] PATH_INFO: `/v3/users/7efe317417084146a0ff20116ed48cbb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:13.946507 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efe317417084146a0ff20116ed48cbb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:13.948505 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:13.997657 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efe317417084146a0ff20116ed48cbb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:13.998347 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efe317417084146a0ff20116ed48cbb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.010480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efe317417084146a0ff20116ed48cbb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.017828 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efe317417084146a0ff20116ed48cbb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.026807 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efe317417084146a0ff20116ed48cbb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.032731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1397/2788] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:13 2022] DELETE /identity/v3/users/7efe317417084146a0ff20116ed48cbb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:14.231308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:14.243277 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e1b7-b3ae-4302-83be-4a4f0ed89efc service nova] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:14.310009 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:14.310897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:14.311208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:14.311492 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] PATH_INFO: `/v3/projects/eb89e1020d944ea08b4294be0ac00cbf` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:14.312800 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb89e1020d944ea08b4294be0ac00cbf)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:14.314740 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:14.368674 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb89e1020d944ea08b4294be0ac00cbf', 'request_id': 'req-98b883e8-e2e3-49b1-9c17-94811dfb0b97'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.373900 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb89e1020d944ea08b4294be0ac00cbf', 'request_id': 'req-98b883e8-e2e3-49b1-9c17-94811dfb0b97'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.384022 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb89e1020d944ea08b4294be0ac00cbf', 'request_id': 'req-98b883e8-e2e3-49b1-9c17-94811dfb0b97'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.398639 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] The token cache is being invalidate because project eb89e1020d944ea08b4294be0ac00cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:14.398934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.399593 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.401290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1392/2789] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:14 2022] DELETE /identity/v3/projects/eb89e1020d944ea08b4294be0ac00cbf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:14.405463 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:14.406915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:14.420162 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f09-ad3a-4a4d-959a-21dc0610866d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:14.478665 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:14.479536 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:14.479822 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:14.480099 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] PATH_INFO: `/v3/users/3225f53444924e93a8f317510de3bc94` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:14.481342 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3225f53444924e93a8f317510de3bc94)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:14.483279 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:14.531208 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3225f53444924e93a8f317510de3bc94'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.531826 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3225f53444924e93a8f317510de3bc94'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.543115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3225f53444924e93a8f317510de3bc94'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.549568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3225f53444924e93a8f317510de3bc94'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.558565 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3225f53444924e93a8f317510de3bc94'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.564710 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1398/2790] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:14 2022] DELETE /identity/v3/users/3225f53444924e93a8f317510de3bc94 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:14.752213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:14.754134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:14.772372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b883e8-e2e3-49b1-9c17-94811dfb0b97 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:14.828091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:14.828993 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:14.829330 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:14.829600 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] PATH_INFO: `/v3/projects/0a1c3b627294487c9e37a6219d70353f` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:14.830814 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1c3b627294487c9e37a6219d70353f)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:14.832914 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:14.879070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1c3b627294487c9e37a6219d70353f', 'request_id': 'req-905bd4aa-2b1b-48a4-9d27-e55321038f0d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.885090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1c3b627294487c9e37a6219d70353f', 'request_id': 'req-905bd4aa-2b1b-48a4-9d27-e55321038f0d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.893690 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1c3b627294487c9e37a6219d70353f', 'request_id': 'req-905bd4aa-2b1b-48a4-9d27-e55321038f0d'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.905371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] The token cache is being invalidate because project 0a1c3b627294487c9e37a6219d70353f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:14.905660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.906364 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:14.907932 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1393/2791] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:14 2022] DELETE /identity/v3/projects/0a1c3b627294487c9e37a6219d70353f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:19.952669 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:19.954214 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:19.967930 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ba28-faae-4d9f-87c9-6b243e22d025 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.021398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.022311 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.022588 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.022858 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] PATH_INFO: `/v3/users/0e56ccc11ac043af908dbfe3a10c9a55` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.024127 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e56ccc11ac043af908dbfe3a10c9a55)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.026147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.074895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e56ccc11ac043af908dbfe3a10c9a55'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.075604 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e56ccc11ac043af908dbfe3a10c9a55'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.086965 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e56ccc11ac043af908dbfe3a10c9a55'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.093621 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e56ccc11ac043af908dbfe3a10c9a55'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.102659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4ef34b29-236c-4d3e-9823-0e955da5fa8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e56ccc11ac043af908dbfe3a10c9a55'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.109085 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1399/2792] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:19 2022] DELETE /identity/v3/users/0e56ccc11ac043af908dbfe3a10c9a55 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:20.281455 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.282957 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:20.295919 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd4aa-2b1b-48a4-9d27-e55321038f0d admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.364997 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.365991 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.366284 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.366539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] PATH_INFO: `/v3/projects/1ccbb9b8d11b499cb9e84da27dd464e6` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.367840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccbb9b8d11b499cb9e84da27dd464e6)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.369886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.429770 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccbb9b8d11b499cb9e84da27dd464e6', 'request_id': 'req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.436285 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccbb9b8d11b499cb9e84da27dd464e6', 'request_id': 'req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.446310 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccbb9b8d11b499cb9e84da27dd464e6', 'request_id': 'req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.459239 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] The token cache is being invalidate because project 1ccbb9b8d11b499cb9e84da27dd464e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:20.459495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.460188 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9cf50cb9-c9a7-4ea4-8159-de9de7d51a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:20.461851 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1394/2793] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:20 2022] DELETE /identity/v3/projects/1ccbb9b8d11b499cb9e84da27dd464e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:20.467891 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.468177 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.468480 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.487731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:20.489079 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:20.548458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1400/2794] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:20.557567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.557878 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.558258 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.580117 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:20.581440 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:20.589891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1395/2795] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:20.594128 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.604087 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471baa3-748f-4dc1-86e0-63ce139ba5d1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.609005 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.609659 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.609945 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.610239 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.610960 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:48:20.611271 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.613030 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.624534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1401/2796] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:48:20.628698 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.638100 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eee68e-71f8-4f09-9b8a-30be067b6b33 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.643187 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.643845 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.644134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.644409 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.645160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.647076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.675474 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1396/2797] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:20 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:20.679717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.690024 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e56b8-9c87-4294-a004-d29da586ada9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.749157 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.749985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.750447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.750824 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.751969 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.754712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.775445 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1402/2798] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:20 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:20.779634 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.790370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61b92-c007-4e23-815b-8ca4a65cf317 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.795930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.796607 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.796889 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.797159 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.797879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.799477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.810795 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1397/2799] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:20.814790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.825489 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d867a-84f8-4dd1-bc13-b03abaa856f1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.830806 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.831468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.831728 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.832007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.832782 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.834395 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662526d0-d64b-4163-b50a-1be53917913d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.844802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1403/2800] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:20.849540 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:20.859846 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979af00-1434-4f46-8637-f348562058ee admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:20.865142 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:20.866024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.866305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.866642 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] PATH_INFO: `/v3/projects/e842947c05fb4b7380bad633694a2fff/users/991a5cea50a74c2c849cf7fd2734d728/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.883073 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e842947c05fb4b7380bad633694a2fff, user_id=991a5cea50a74c2c849cf7fd2734d728, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:20.885766 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:20.901934 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1398/2801] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:20 2022] PUT /identity/v3/projects/e842947c05fb4b7380bad633694a2fff/users/991a5cea50a74c2c849cf7fd2734d728/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:20.912129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:20.912419 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:20.912745 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:20.940477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] MFA Rules not processed for user `991a5cea50a74c2c849cf7fd2734d728`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:20.941732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:21.004759 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1404/2802] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:21.009460 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.076084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89f26-e199-4dc3-802c-cafd218b8c28 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.081438 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.082098 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.082380 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.082660 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.083334 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.085353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.113353 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1399/2803] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:21 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:21.118179 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.135646 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ee290-5844-458d-bde0-2e6cf32f9cd5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.204472 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.205170 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.205427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.205701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.206403 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.208325 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.234448 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1405/2804] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:21 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:48:21.240157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.251203 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5833-122e-4570-8831-07606624cdc5 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.256108 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.256801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.257084 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.257363 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.258123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.262209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.273487 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1400/2805] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:21.278026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.288362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005730ea-f555-4a46-8632-c14b74c5cf95 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.293440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.294331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.294635 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.294918 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] PATH_INFO: `/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7/users/fbe732cd23bf4ccb890bd6fba95f7349/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.311486 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b040cd10fed54fbd9e5c376230d5e8a7, user_id=fbe732cd23bf4ccb890bd6fba95f7349, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.314196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.329477 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1406/2806] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:21 2022] PUT /identity/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7/users/fbe732cd23bf4ccb890bd6fba95f7349/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:21.333721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.344249 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfff9-eca9-429b-ba4c-70dc3999c212 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.402980 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.403689 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.403974 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.404248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.405024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.406635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb163229-2721-4d14-a92d-3ecd840324f4 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.422248 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1401/2807] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:21.426809 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.437857 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1a0-4227-475f-acb2-983a52ffe6ee admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.443327 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.444210 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.444607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.444881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] PATH_INFO: `/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7/users/fbe732cd23bf4ccb890bd6fba95f7349/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.446970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b040cd10fed54fbd9e5c376230d5e8a7, user_id=fbe732cd23bf4ccb890bd6fba95f7349, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.449653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.460228 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1407/2808] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:21 2022] PUT /identity/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7/users/fbe732cd23bf4ccb890bd6fba95f7349/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:21.470195 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.470490 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.470801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.498645 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] MFA Rules not processed for user `fbe732cd23bf4ccb890bd6fba95f7349`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:21.499893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:21.576420 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1402/2809] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:21.588001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.590169 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:21.649483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a12a1-56e7-428d-b748-aec32eb8266f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.654156 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.654812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.655095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.655371 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.666065 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.667543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050b207-ab3d-4aee-9f53-920661457457 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.677633 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1408/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:21.750058 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:21.815566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5cd0-00bb-41a4-b14e-eca63288f12f None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:21.821091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:21.821972 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.822262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.822532 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] PATH_INFO: `/v3/users/991a5cea50a74c2c849cf7fd2734d728` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.823791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=991a5cea50a74c2c849cf7fd2734d728)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:21.825748 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:21.884573 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991a5cea50a74c2c849cf7fd2734d728'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:21.902741 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991a5cea50a74c2c849cf7fd2734d728'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:21.909948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991a5cea50a74c2c849cf7fd2734d728'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:21.910675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991a5cea50a74c2c849cf7fd2734d728'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:21.920688 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991a5cea50a74c2c849cf7fd2734d728'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:21.929760 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1403/2811] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:21 2022] DELETE /identity/v3/users/991a5cea50a74c2c849cf7fd2734d728 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:21.934859 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:21.935150 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:21.935427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:21.953731 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:21.954937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:22.017568 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1409/2812] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:22.029091 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:22.030665 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:22.087700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826ed7-1d32-47ad-a864-40c893116fed admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:22.091925 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:22.092606 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:22.092891 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:22.093161 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:22.102706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:22.104138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:22.113575 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1404/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:22.389190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:22.390661 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:22.402711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6d4d9-f3a7-4722-94fb-2450d2176194 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:22.407810 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:22.408736 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:22.409023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:22.409287 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] PATH_INFO: `/v3/projects/e842947c05fb4b7380bad633694a2fff` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:22.410473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e842947c05fb4b7380bad633694a2fff)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:22.412398 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:22.466407 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e842947c05fb4b7380bad633694a2fff', 'request_id': 'req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.471538 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e842947c05fb4b7380bad633694a2fff', 'request_id': 'req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.479925 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e842947c05fb4b7380bad633694a2fff', 'request_id': 'req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.491109 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] The token cache is being invalidate because project e842947c05fb4b7380bad633694a2fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:22.491434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.492086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.493676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1410/2814] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:22 2022] DELETE /identity/v3/projects/e842947c05fb4b7380bad633694a2fff => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:22.497865 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:22.507703 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db565b9-6b18-4ee8-9493-879d351d2f67 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:22.575201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:22.576701 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:22.577125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:22.577535 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] PATH_INFO: `/v3/users/fbe732cd23bf4ccb890bd6fba95f7349` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:22.579529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe732cd23bf4ccb890bd6fba95f7349)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:22.582658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:22.630809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe732cd23bf4ccb890bd6fba95f7349'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.644095 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe732cd23bf4ccb890bd6fba95f7349'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.651627 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe732cd23bf4ccb890bd6fba95f7349'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.652344 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe732cd23bf4ccb890bd6fba95f7349'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.662563 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-53d42e3b-ccf5-457f-8889-64743108a2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe732cd23bf4ccb890bd6fba95f7349'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:22.669331 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1405/2815] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:22 2022] DELETE /identity/v3/users/fbe732cd23bf4ccb890bd6fba95f7349 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:22.940075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:22.941761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:22.955764 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd27-0fd0-4e8d-a5f1-78a9ac6820dc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.015196 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.015992 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.016276 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.016586 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] PATH_INFO: `/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.017817 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b040cd10fed54fbd9e5c376230d5e8a7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.019748 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.067414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b040cd10fed54fbd9e5c376230d5e8a7', 'request_id': 'req-bafbf139-448a-4b3f-86fb-72f5bc0aca33'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:23.072901 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b040cd10fed54fbd9e5c376230d5e8a7', 'request_id': 'req-bafbf139-448a-4b3f-86fb-72f5bc0aca33'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:23.081520 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b040cd10fed54fbd9e5c376230d5e8a7', 'request_id': 'req-bafbf139-448a-4b3f-86fb-72f5bc0aca33'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:23.092328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] The token cache is being invalidate because project b040cd10fed54fbd9e5c376230d5e8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:23.092638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:23.093267 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bafbf139-448a-4b3f-86fb-72f5bc0aca33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:23.094836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1411/2816] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:22 2022] DELETE /identity/v3/projects/b040cd10fed54fbd9e5c376230d5e8a7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:23.099827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ab37-efce-46db-9256-eceb34660dde None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.100124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ab37-efce-46db-9256-eceb34660dde None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.100404 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ab37-efce-46db-9256-eceb34660dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.118352 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-b449ab37-efce-46db-9256-eceb34660dde None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:23.119579 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-b449ab37-efce-46db-9256-eceb34660dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:23.183371 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1406/2817] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:48:23.192911 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.193200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.193479 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.213474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:23.214720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:23.224237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1412/2818] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:23.228696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ab37-efce-46db-9256-eceb34660dde None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.238450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ab37-efce-46db-9256-eceb34660dde None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.243777 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.244463 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.244797 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.245046 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.245782 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:48:23.246120 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.247751 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.265145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1407/2819] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:48:23.271517 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.284290 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaba5c-6fdf-42aa-89a5-34a028d739ed None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.290793 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.291456 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.291738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.291988 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.292738 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.294684 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.331471 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1413/2820] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:48:23.337534 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.347995 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c90b2-326c-49c5-a3c7-118b348d490b admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.404834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.405505 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.405791 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.406066 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.406758 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.408696 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.431603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1408/2821] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:23.436251 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.447440 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755db0-e9de-463b-a55a-3270b6eed5de admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.452496 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.453191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.453476 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.453747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.454474 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.456039 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.466459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1414/2822] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:23.471172 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.485569 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042643c-3b73-45fe-ac6e-963c9cc5ac2e admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.493201 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.493867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.494152 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.494426 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.495157 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.496811 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d087282-b0fa-4250-b01f-d868cc7198a8 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.508860 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1409/2823] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:48:23.513288 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.523696 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aa9f3-3aee-44ed-9804-6818012858a5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.530036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.531319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.531676 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.532041 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] PATH_INFO: `/v3/projects/619216dd8ae5494c8a79f10110384e44/users/e08c0035040048a3b84b87dd869dc208/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.549774 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619216dd8ae5494c8a79f10110384e44, user_id=e08c0035040048a3b84b87dd869dc208, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.552473 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.566898 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1415/2824] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:23 2022] PUT /identity/v3/projects/619216dd8ae5494c8a79f10110384e44/users/e08c0035040048a3b84b87dd869dc208/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:23.577494 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.577784 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.578062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.606434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] MFA Rules not processed for user `e08c0035040048a3b84b87dd869dc208`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:23.607635 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:23.677733 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1410/2825] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:23.682577 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.745671 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430e32-fb60-4d04-9d81-5538d24314d8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.751176 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.751827 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.752132 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.752400 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.753122 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.755019 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.782006 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1416/2826] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:23.786145 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.797653 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8ebb-617f-485c-8e17-63539d266805 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.855123 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.855788 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.856070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.856343 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.857053 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.858951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.880706 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1411/2827] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:23 2022] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:23.885145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.895894 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793e7f-4d41-4209-98f2-d5affa500999 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.901703 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.902362 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.902644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.902916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.903637 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.905357 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.915950 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1417/2828] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:23.920753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.934499 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1987cfc-349c-4c38-adbf-cb68b6facdc3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:23.940167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:23.941103 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:23.941385 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:23.941659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] PATH_INFO: `/v3/projects/384c8965ad604d09a19aa406ca0e31fe/users/eacbef93ba5e427088e355bfa8621e9c/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:23.957232 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384c8965ad604d09a19aa406ca0e31fe, user_id=eacbef93ba5e427088e355bfa8621e9c, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:23.959949 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:23.974730 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1412/2829] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:23 2022] PUT /identity/v3/projects/384c8965ad604d09a19aa406ca0e31fe/users/eacbef93ba5e427088e355bfa8621e9c/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:23.978740 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:23.989145 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2760-2f1b-4479-870b-fa5210e1b5f6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:24.046337 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:24.046976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:24.046976 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:24.047215 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:24.047970 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:24.049608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dc06a-3a36-454f-a536-49c6be7ff039 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:24.059639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1418/2830] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:24.066357 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:24.081267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adbd96-fd82-46bd-83bf-580a743d6237 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:24.087632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:24.088551 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:24.088835 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:24.089107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] PATH_INFO: `/v3/projects/384c8965ad604d09a19aa406ca0e31fe/users/eacbef93ba5e427088e355bfa8621e9c/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:24.091029 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384c8965ad604d09a19aa406ca0e31fe, user_id=eacbef93ba5e427088e355bfa8621e9c, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:24.093700 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:24.103393 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1413/2831] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:24 2022] PUT /identity/v3/projects/384c8965ad604d09a19aa406ca0e31fe/users/eacbef93ba5e427088e355bfa8621e9c/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:24.114593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:24.114881 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:24.115163 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:24.142802 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] MFA Rules not processed for user `eacbef93ba5e427088e355bfa8621e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:24.144029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:24.214638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1419/2832] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:48:24.225585 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:24.227488 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:24.287312 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b9d2-9eb0-40cc-af67-6bf227116d11 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:24.292211 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:24.292895 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:24.293174 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:24.293447 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:24.302879 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:24.304260 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:24.313990 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1414/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:24.489055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:24.498942 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b9fc-9351-44ec-bdb5-4c841198faa3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:24.502879 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:24.503543 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:24.503825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:24.504102 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:24.576234 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:24.577643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712be51-cb19-4039-88fd-352c83e246fe service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:24.586682 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1420/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:31.948348 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:32.009987 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948804-3ae4-4745-abfe-0684a51a2d77 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:32.014853 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:32.015736 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:32.016012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:32.016292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] PATH_INFO: `/v3/users/e08c0035040048a3b84b87dd869dc208` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:32.017526 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08c0035040048a3b84b87dd869dc208)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:32.019458 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:32.066954 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08c0035040048a3b84b87dd869dc208'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.078432 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08c0035040048a3b84b87dd869dc208'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.085134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08c0035040048a3b84b87dd869dc208'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.085807 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08c0035040048a3b84b87dd869dc208'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.095818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08c0035040048a3b84b87dd869dc208'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.102367 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1415/2835] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:31 2022] DELETE /identity/v3/users/e08c0035040048a3b84b87dd869dc208 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:32.107152 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:32.107705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:32.107705 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:32.125409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:32.126615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:32.191620 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1421/2836] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:32.201503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:32.203132 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:32.264450 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3c5e-e6e9-439d-9f85-8beaa530b953 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:32.268720 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:32.269373 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:32.269657 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:32.269943 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:32.279567 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:32.281037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:32.290464 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1416/2837] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:32.561414 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:32.563023 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:32.577343 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518ca6-3cc5-4598-87ac-6d81b574286c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:32.582979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:32.584011 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:32.584143 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:32.584373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] PATH_INFO: `/v3/projects/619216dd8ae5494c8a79f10110384e44` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:32.585626 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619216dd8ae5494c8a79f10110384e44)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:32.587539 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:32.635086 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619216dd8ae5494c8a79f10110384e44', 'request_id': 'req-99866615-6134-45a1-b2d4-a433376eb5e8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.640701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619216dd8ae5494c8a79f10110384e44', 'request_id': 'req-99866615-6134-45a1-b2d4-a433376eb5e8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.648790 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619216dd8ae5494c8a79f10110384e44', 'request_id': 'req-99866615-6134-45a1-b2d4-a433376eb5e8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.660106 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] The token cache is being invalidate because project 619216dd8ae5494c8a79f10110384e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:32.660391 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.661068 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.662638 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1422/2838] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:32 2022] DELETE /identity/v3/projects/619216dd8ae5494c8a79f10110384e44 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:32.666734 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:32.676903 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48493410-932b-44c5-9c6f-4256b7ee4381 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:32.732414 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:32.733243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:32.733527 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:32.733806 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] PATH_INFO: `/v3/users/eacbef93ba5e427088e355bfa8621e9c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:32.735090 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacbef93ba5e427088e355bfa8621e9c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:32.737082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:32.792397 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacbef93ba5e427088e355bfa8621e9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.803892 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacbef93ba5e427088e355bfa8621e9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.810947 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacbef93ba5e427088e355bfa8621e9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.811631 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacbef93ba5e427088e355bfa8621e9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.820311 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-d084d9a0-01b3-4fb3-997a-dc4f4a4f9d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacbef93ba5e427088e355bfa8621e9c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:32.826418 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1417/2839] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:32 2022] DELETE /identity/v3/users/eacbef93ba5e427088e355bfa8621e9c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:33.106270 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.107756 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:33.121519 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866615-6134-45a1-b2d4-a433376eb5e8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.182602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.183469 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.184115 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.184386 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] PATH_INFO: `/v3/projects/384c8965ad604d09a19aa406ca0e31fe` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.185605 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=384c8965ad604d09a19aa406ca0e31fe)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.187558 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.237534 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384c8965ad604d09a19aa406ca0e31fe', 'request_id': 'req-c84eaf1a-7323-4695-b910-030b8db2a21b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:33.243526 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384c8965ad604d09a19aa406ca0e31fe', 'request_id': 'req-c84eaf1a-7323-4695-b910-030b8db2a21b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:33.253242 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384c8965ad604d09a19aa406ca0e31fe', 'request_id': 'req-c84eaf1a-7323-4695-b910-030b8db2a21b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:33.265562 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] The token cache is being invalidate because project 384c8965ad604d09a19aa406ca0e31fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:33.265850 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:33.266499 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c84eaf1a-7323-4695-b910-030b8db2a21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:33.268072 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1423/2840] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:33 2022] DELETE /identity/v3/projects/384c8965ad604d09a19aa406ca0e31fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:33.273125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.273599 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.273704 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.292012 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:33.293251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:33.366119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1418/2841] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:33.374301 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.374587 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.374861 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.394468 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:33.395653 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:33.403937 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1424/2842] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:33.408107 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.417894 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193f61-b171-49ca-ae6a-fc83bbe21942 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.426624 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.427546 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.427901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.428273 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.429370 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:48:33.429804 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.432308 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.449753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1419/2843] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:48:33.453944 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.464200 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c68a4-75db-43a0-b930-8f010e57bd7a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.470602 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.471513 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.471829 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.472147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.473113 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.475078 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.502417 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1425/2844] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:33.506658 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.516721 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4a65-7689-4f98-9674-36fba90895b3 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.575262 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.575930 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.576213 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.576496 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.577180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.579093 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.603663 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1420/2845] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:33.607973 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.618673 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21158462-3f4c-477c-ad08-d1e71fc4a938 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.624073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.624791 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.625071 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.625319 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.626074 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.627674 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.638259 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1426/2846] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:33.643286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.654017 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5691-c26b-4b6f-94b1-230ffaded668 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.659867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.660603 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.660886 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.661162 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.661890 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.663493 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1355-af3d-4f43-8984-db876f715c0b admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.674008 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1421/2847] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:33.678447 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.688979 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af4b13-27da-4a33-8f96-e279b4e4cb1a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.693836 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.694712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.694985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.695255 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] PATH_INFO: `/v3/projects/67a8bc1f526944ff8d0ba36d347730e9/users/000848e7c72a4ecb93cc7cdcc3932171/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.709329 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a8bc1f526944ff8d0ba36d347730e9, user_id=000848e7c72a4ecb93cc7cdcc3932171, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.711968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.725906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1427/2848] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:33 2022] PUT /identity/v3/projects/67a8bc1f526944ff8d0ba36d347730e9/users/000848e7c72a4ecb93cc7cdcc3932171/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:33.737290 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.737739 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.738155 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.768617 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] MFA Rules not processed for user `000848e7c72a4ecb93cc7cdcc3932171`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:33.769778 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:33.835434 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1422/2849] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:33.841029 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.903966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9492-eaf6-48a6-bc06-faf7f7344dff admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:33.908711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:33.909363 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:33.909643 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:33.909909 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:33.910594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:33.912498 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:33.941544 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1428/2850] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:33.945888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:33.957158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2fc6a-0727-4f6d-aa21-af1d79b8bf87 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.013750 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.014421 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.014708 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.014989 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.015711 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.017675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.041215 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1423/2851] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:33 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:34.045351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.055595 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee531-1d6b-4397-9575-3daf58dd65f8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.061144 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.061814 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.062095 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.062415 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.063147 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.064818 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.075739 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1429/2852] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:48:34.082002 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.096583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6e06f-26eb-424a-adc0-260b32ee7472 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.103832 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.104737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.105037 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.105305 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] PATH_INFO: `/v3/projects/818ec04511cd4631b4dbe471b0bd658f/users/6dae39d94f1b4c018eb7393df7d8df5c/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.119901 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818ec04511cd4631b4dbe471b0bd658f, user_id=6dae39d94f1b4c018eb7393df7d8df5c, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.122566 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.137457 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1424/2853] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:34 2022] PUT /identity/v3/projects/818ec04511cd4631b4dbe471b0bd658f/users/6dae39d94f1b4c018eb7393df7d8df5c/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:34.141624 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.151843 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d76a-aaa3-4bac-966d-bf6f517679f8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.207741 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.208409 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.208727 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.209007 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.209753 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.211353 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de800-1f78-4507-a493-f7cc695c0803 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.221001 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1430/2854] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:34.225503 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.236386 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91a4a-6c56-4fb6-a985-673f5e89c9b0 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.242396 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.243280 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.243557 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.243836 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] PATH_INFO: `/v3/projects/818ec04511cd4631b4dbe471b0bd658f/users/6dae39d94f1b4c018eb7393df7d8df5c/roles/4f500164fa794f84afa94241394a2b5d` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.245992 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=818ec04511cd4631b4dbe471b0bd658f, user_id=6dae39d94f1b4c018eb7393df7d8df5c, role_id=4f500164fa794f84afa94241394a2b5d)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.248684 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.259129 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1425/2855] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:34 2022] PUT /identity/v3/projects/818ec04511cd4631b4dbe471b0bd658f/users/6dae39d94f1b4c018eb7393df7d8df5c/roles/4f500164fa794f84afa94241394a2b5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:34.270331 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.270623 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.270906 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.299644 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] MFA Rules not processed for user `6dae39d94f1b4c018eb7393df7d8df5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:34.300825 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:34.375532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1431/2856] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:34.387351 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.389524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:34.455643 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7863c-2309-42a6-820d-07795df027bc admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.462861 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.463516 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.463801 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.464076 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.474873 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.476322 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.486134 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1426/2857] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:34.573639 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:34.583692 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cca3b-9819-4208-8858-f5cec9e1a7d3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:34.588191 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:34.588882 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:34.589167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:34.589442 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:34.651557 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:34.653076 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc88681-0126-45cf-9ae8-9cb392613ec5 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:34.662384 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1432/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:39.376024 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:39.445826 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124771f-fd6e-4fac-9d62-5c5e52a46921 service cinder] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:39.451208 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:39.452086 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:39.452366 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:39.452675 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] PATH_INFO: `/v3/users/000848e7c72a4ecb93cc7cdcc3932171` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:39.453927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000848e7c72a4ecb93cc7cdcc3932171)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:39.455859 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:39.507787 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000848e7c72a4ecb93cc7cdcc3932171'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:39.520428 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000848e7c72a4ecb93cc7cdcc3932171'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:39.527839 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000848e7c72a4ecb93cc7cdcc3932171'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:39.528725 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000848e7c72a4ecb93cc7cdcc3932171'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:39.537789 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000848e7c72a4ecb93cc7cdcc3932171'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:39.544403 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1427/2859] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:39 2022] DELETE /identity/v3/users/000848e7c72a4ecb93cc7cdcc3932171 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:39.549090 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:39.549593 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:39.549729 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:39.568193 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:39.569426 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:39.629717 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1433/2860] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:39.639911 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:39.642286 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:39.708876 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18c53e-1594-43ac-a8d3-cba1a9e585e2 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:39.713477 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:39.714148 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:39.714436 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:39.714774 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:39.724237 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:39.725731 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:39.735220 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1428/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:40.001966 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.003597 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:40.018096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba48cd-8cf6-43b5-b6d5-4c37babe9e28 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.023302 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.024183 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.024482 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.024838 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] PATH_INFO: `/v3/projects/67a8bc1f526944ff8d0ba36d347730e9` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.026013 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a8bc1f526944ff8d0ba36d347730e9)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.028000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:40.076683 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a8bc1f526944ff8d0ba36d347730e9', 'request_id': 'req-85447f5a-2a96-41d7-ab8d-85093254cdd6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.082197 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a8bc1f526944ff8d0ba36d347730e9', 'request_id': 'req-85447f5a-2a96-41d7-ab8d-85093254cdd6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.090385 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a8bc1f526944ff8d0ba36d347730e9', 'request_id': 'req-85447f5a-2a96-41d7-ab8d-85093254cdd6'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.101066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] The token cache is being invalidate because project 67a8bc1f526944ff8d0ba36d347730e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:40.101341 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.101948 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.103458 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1434/2862] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:40 2022] DELETE /identity/v3/projects/67a8bc1f526944ff8d0ba36d347730e9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:40.107671 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.117486 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c033de-093c-453c-9f81-1e02eecf8e00 service neutron] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.175632 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.176539 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.176816 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.177106 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] PATH_INFO: `/v3/users/6dae39d94f1b4c018eb7393df7d8df5c` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.178306 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dae39d94f1b4c018eb7393df7d8df5c)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.180267 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:40.228712 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dae39d94f1b4c018eb7393df7d8df5c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.240270 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dae39d94f1b4c018eb7393df7d8df5c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.248065 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dae39d94f1b4c018eb7393df7d8df5c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.248842 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dae39d94f1b4c018eb7393df7d8df5c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.258834 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-513cd153-735e-41c8-a3ca-2651486610ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dae39d94f1b4c018eb7393df7d8df5c'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.267935 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1429/2863] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:48:40 2022] DELETE /identity/v3/users/6dae39d94f1b4c018eb7393df7d8df5c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:40.544895 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.546459 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:40.559582 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447f5a-2a96-41d7-ab8d-85093254cdd6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.616502 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.617326 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.617608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.617877 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] PATH_INFO: `/v3/projects/818ec04511cd4631b4dbe471b0bd658f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.619136 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818ec04511cd4631b4dbe471b0bd658f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.621174 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:40.669916 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818ec04511cd4631b4dbe471b0bd658f', 'request_id': 'req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.676522 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818ec04511cd4631b4dbe471b0bd658f', 'request_id': 'req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.687762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818ec04511cd4631b4dbe471b0bd658f', 'request_id': 'req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.704733 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] The token cache is being invalidate because project 818ec04511cd4631b4dbe471b0bd658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:48:40.705022 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.705744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60fc3c20-9e1d-4e8d-bd9f-388d8c439201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:48:40.707433 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1435/2864] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:48:40 2022] DELETE /identity/v3/projects/818ec04511cd4631b4dbe471b0bd658f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:40.712654 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.713160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.713160 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.732051 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:40.733372 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:40.792747 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1430/2865] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:40.801273 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.801555 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.801835 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.821701 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:40.822951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:40.832010 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1436/2866] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:48:40.836133 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.845994 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323b26-2932-40d4-92c5-33e89017ea91 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.851004 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.851648 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.851931 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.852204 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] PATH_INFO: `/v3/domains` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.852951 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:48:40.853250 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.854864 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:40.866355 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1431/2867] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 16 20:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:48:40.870608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.880167 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc22cd6-8c81-4706-8f44-1484fb6a4161 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.885815 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.886467 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.886747 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.887020 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.887706 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.889749 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:40.917902 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1437/2868] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 16 20:48:40 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:40.922138 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:40.932361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa68230-74df-4763-a47c-4dd47ca48680 admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:40.993099 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:40.993952 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:40.994400 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:40.994897 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] PATH_INFO: `/v3/users` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:40.996209 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:40.998912 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:41.026153 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1432/2869] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 16 20:48:40 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:48:41.031073 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:41.042446 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bacc0-1c6a-4ccb-91e2-22b70fcbeec5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:41.048762 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:41.049431 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.049712 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.049985 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.050711 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:41.052323 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:41.063896 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1438/2870] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:41.069562 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:41.079818 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1137-28f8-4224-95cb-4fe7a81e250f admin admin] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:41.084583 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:41.085243 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.085524 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.085798 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] PATH_INFO: `/v3/roles` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.086518 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:41.088124 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563ff7-d5a7-450f-95bd-935c67e7adab admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:41.098471 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1433/2871] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 16 20:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:48:41.102615 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:41.112590 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf621-94d3-496e-b7f3-48ec87d75714 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:41.117503 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:41.118377 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.118660 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.118934 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] PATH_INFO: `/v3/projects/b034bbaaf0414b5aaf2d0f33c24283e8/users/7d8b9804df834dbaa758e9777e51757d/roles/99ac4a09727c4646a782397c7f07e9c3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.133900 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b034bbaaf0414b5aaf2d0f33c24283e8, user_id=7d8b9804df834dbaa758e9777e51757d, role_id=99ac4a09727c4646a782397c7f07e9c3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:41.136483 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:41.150983 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1439/2872] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 16 20:48:41 2022] PUT /identity/v3/projects/b034bbaaf0414b5aaf2d0f33c24283e8/users/7d8b9804df834dbaa758e9777e51757d/roles/99ac4a09727c4646a782397c7f07e9c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:48:41.157154 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d30dd-cfd6-4a57-8b9c-e13b962cfe95 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.157437 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d30dd-cfd6-4a57-8b9c-e13b962cfe95 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.157717 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d30dd-cfd6-4a57-8b9c-e13b962cfe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.175927 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-2f7d30dd-cfd6-4a57-8b9c-e13b962cfe95 None None] MFA Rules not processed for user `fc0c07a955fe4edc868e35eb1b8525a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:41.177165 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-2f7d30dd-cfd6-4a57-8b9c-e13b962cfe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:41.236292 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1434/2873] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:41.246184 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:41.248261 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:41.307551 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b97014-97e9-4a0e-990f-83917b839ef3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:41.312744 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:41.313434 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.313720 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.313997 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.324096 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:41.325581 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:41.338723 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1440/2874] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:41.941214 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309c0-fd29-4d99-983d-0a64d514aed1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:41.941737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309c0-fd29-4d99-983d-0a64d514aed1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:41.941737 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309c0-fd29-4d99-983d-0a64d514aed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:41.968180 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-a97309c0-fd29-4d99-983d-0a64d514aed1 None None] MFA Rules not processed for user `7d8b9804df834dbaa758e9777e51757d`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:41.970151 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-a97309c0-fd29-4d99-983d-0a64d514aed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:42.032529 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1435/2875] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:42.043306 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:42.044732 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:42.101084 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1024a0-0ba0-449d-b674-366dee79c493 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:42.104883 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46868d054b34480935d579ea9b22171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:42.105608 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:42.105761 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:42.106026 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:42.114592 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:42.116042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:42.124926 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1441/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:43.476652 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:43.477244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:43.477244 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:43.495071 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] MFA Rules not processed for user `7d8b9804df834dbaa758e9777e51757d`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:43.496296 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:43.504587 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1436/2877] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:48:43.740462 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:43.742050 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:43.754360 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7d07b-810d-4922-8baa-603470ef42bc service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:43.758367 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3095aa719bfd4f6e803ade0e33e09697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:43.758993 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:43.759268 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:43.759532 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:43.761382 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:43.770957 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:43.772312 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:43.780373 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1442/2878] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:44.123395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:44.125019 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:44.194707 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ca222-0cf8-45bb-83f7-f98c92f519d1 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:44.199856 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:44.200553 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:44.200840 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:44.201119 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:44.202948 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:44.214295 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:44.215893 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d338a0-3fc7-4214-8863-8e3bb985c976 service placement] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:44.225888 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1437/2879] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:52.322190 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:48:52.324000 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:52.405328 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427991bf-4e1b-4375-8379-f0839083ac80 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:48:52.411293 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ed0368b15743bb8a8cec086c575d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:48:52.411951 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:52.412237 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:52.412559 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:52.414322 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:52.426397 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:48:52.428154 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78248e-f347-4357-8ac1-3405be08586c service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:48:52.439055 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1443/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:48:57.784251 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] REQUEST_METHOD: `POST` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:48:57.784827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:48:57.784827 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:48:57.808601 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.auth.core [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] MFA Rules not processed for user `7d8b9804df834dbaa758e9777e51757d`. Rule list: `[]` (Enabled: `True`). {{(pid=79846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:48:57.809829 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:48:57.817753 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1438/2881] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 16 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:49:14.005702 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a749-d27b-4fc1-b6f7-464a7f46e308 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:14.006252 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a749-d27b-4fc1-b6f7-464a7f46e308 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:14.006379 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a749-d27b-4fc1-b6f7-464a7f46e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:14.034571 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3613a749-d27b-4fc1-b6f7-464a7f46e308 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:49:14.035775 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3613a749-d27b-4fc1-b6f7-464a7f46e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:49:14.110066 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1444/2882] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 16 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:49:14.160082 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:49:14.161596 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.fernet_utils [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:49:14.272659 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919dc40-0810-411c-9824-2bae7dbfd5f3 None None] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:49:14.278300 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:49:14.278966 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:14.279246 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:14.279520 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:14.288219 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:49:14.289867 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:49:14.299070 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1439/2883] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:49:28.054573 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:28.055125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:28.055125 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:28.083042 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] MFA Rules not processed for user `dd74544a48d14b728df81973ed0c9cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:49:28.084221 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:49:28.098427 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1445/2884] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 16 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:49:28.110920 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:49:28.121613 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699e63-630c-4f76-af1b-6f22fd5bda64 service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:49:28.126968 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839acae1c8eb4ff29260410a01f2ced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:49:28.127604 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] REQUEST_METHOD: `GET` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:28.127885 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:28.128158 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:28.136578 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:49:28.138167 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:49:28.146478 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1440/2885] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 16 20:49:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:49:30.071750 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:49:30.104547 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e8eb2-ac3d-408a-bd9a-da281aeecf48 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:49:30.109915 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:49:30.110847 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:30.111075 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:30.111351 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] PATH_INFO: `/v3/users/7d8b9804df834dbaa758e9777e51757d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:30.112594 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8b9804df834dbaa758e9777e51757d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:49:30.114533 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:49:30.163114 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8b9804df834dbaa758e9777e51757d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.163812 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8b9804df834dbaa758e9777e51757d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.176054 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8b9804df834dbaa758e9777e51757d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.183280 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8b9804df834dbaa758e9777e51757d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.192767 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8b9804df834dbaa758e9777e51757d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.199036 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1446/2886] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 16 20:49:30 2022] DELETE /identity/v3/users/7d8b9804df834dbaa758e9777e51757d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:49:30.373395 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] Authenticating user token {{(pid=79846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:49:30.384661 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f5bb3-f707-4513-a3f2-0a9cee9e4931 service swift] Validating token access rules against request {{(pid=79846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:49:30.445361 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c07a955fe4edc868e35eb1b8525a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0e31e92b6648feab627c19ac9bf98d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:49:30.446226 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:49:30.446495 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:49:30.446765 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] PATH_INFO: `/v3/projects/b034bbaaf0414b5aaf2d0f33c24283e8` {{(pid=79846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:49:30.448062 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b034bbaaf0414b5aaf2d0f33c24283e8)` {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:49:30.450125 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] RBAC: Authorization granted {{(pid=79846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:49:30.497871 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'request_id': 'req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.503738 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'request_id': 'req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.511719 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b034bbaaf0414b5aaf2d0f33c24283e8', 'request_id': 'req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff'} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.535544 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] The token cache is being invalidate because project b034bbaaf0414b5aaf2d0f33c24283e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:49:30.535809 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.536667 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: DEBUG keystone.notifications [None req-9b4f6ecf-bd47-4ce4-a30c-f43cf14939ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:49:30.538298 dv-cinder-777031-16-iscsi devstack@keystone.service[79846]: [pid: 79846|app: 0|req: 1441/2887] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 16 20:49:30 2022] DELETE /identity/v3/projects/b034bbaaf0414b5aaf2d0f33c24283e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:51:04.666968 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:51:04.668698 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:51:04.760189 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480787-51a1-4265-8ce0-61cf4de78f41 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:51:04.820921 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec791a20cf54413ab307c7a66892259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faf1841d6fce4ccdb88cd306b21ac996', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:51:04.821563 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:51:04.821849 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:51:04.822129 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:51:04.824081 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:51:04.835607 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:51:04.837236 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537c43-4727-434d-aac7-05816d4c3adf service placement] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:51:04.847155 dv-cinder-777031-16-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1447/2888] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 16 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)